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Preface 


“We see that the theory of probability is at bottom only common sense reduced 
to calculation; it makes us appreciate with exactitude what reasonable minds feel 
by a sort of instinct, often without being able to account for it....It is remarkable 
that this science, which originated in the consideration of games of chance, should 
have become the most important object of human knowledge. ... The most important 
questions of life are, for the most part, really only problems of probability.” So said 
the famous French mathematician and astronomer (the “Newton of France”) Pierre- 
Simon, Marquis de Laplace. Although many people feel that the famous marquis, 
who was also one of the great contributors to the development of probability, might 
have exaggerated somewhat, it is nevertheless true that probability theory has become 
a tool of fundamental importance to nearly all scientists, engineers, medical practi- 
tioners, jurists, and industrialists. In fact, the enlightened individual had learned to 
ask not “Is it so?” but rather “What is the probability that it is so?” 

This book is intended as an elementary introduction to the theory of probability 
for students in mathematics, statistics, engineering, and the sciences (including com- 
puter science, biology, the social sciences, and management science) who possess the 
prerequisite knowledge of elementary calculus. It attempts to present not only the 
mathematics of probability theory, but also, through numerous examples, the many 
diverse possible applications of this subject. 

Chapter 1 presents the basic principles of combinatorial analysis, which are most 
useful in computing probabilities. 

Chapter 2 handles the axioms of probability theory and shows how they can be 
applied to compute various probabilities of interest. 

Chapter 3 deals with the extremely important subjects of conditional probability 
and independence of events. By a series of examples, we illustrate how conditional 
probabilities come into play not only when some partial information is available, 
but also as a tool to enable us to compute probabilities more easily, even when 
no partial information is present. This extremely important technique of obtaining 
probabilities by “conditioning” reappears in Chapter 7, where we use it to obtain 
expectations. 

The concept of random variables is introduced in Chapters 4,5, and 6. Discrete 
random variables are dealt with in Chapter 4, continuous random variables in 
Chapter 5, and jointly distributed random variables in Chapter 6. The important con- 
cepts of the expected value and the variance of a random variable are introduced in 
Chapters 4 and 5, and these quantities are then determined for many of the common 
types of random variables. 

Additional properties of the expected value are considered in Chapter 7. Many 
examples illustrating the usefulness of the result that the expected value of a sum of 
random variables is equal to the sum of their expected values are presented. Sections 
on conditional expectation, including its use in prediction, and on moment-generating 
functions are contained in this chapter. In addition, the final section introduces the 
multivariate normal distribution and presents a simple proof concerning the joint 
distribution of the sample mean and sample variance of a sample from a normal 
distribution. 


xi 


xii 


Preface 


Chapter 8 presents the major theoretical results of probability theory. In partic- 
ular, we prove the strong law of large numbers and the central limit theorem. Our 
proof of the strong law is a relatively simple one which assumes that the random vari- 
ables have a finite fourth moment, and our proof of the central limit theorem assumes 
Levy’s continuity theorem. This chapter also presents such probability inequalities as 
Markov’s inequality, Chebyshev’s inequality, and Chernoff bounds. The final section 
of Chapter 8 gives a bound on the error involved when a probability concerning 
a sum of independent Bernoulli random variables is approximated by the corre- 
sponding probability of a Poisson random variable having the same expected 
value. 

Chapter 9 presents some additional topics, such as Markov chains, the Poisson pro- 
cess, and an introduction to information and coding theory, and Chapter 10 considers 
simulation. 

As in the previous edition, three sets of exercises are given at the end of each 
chapter. They are designated as Problems, Theoretical Exercises, and Self-Test Prob- 
lems and Exercises. This last set of exercises, for which complete solutions appear in 
Solutions to Self-Test Problems and Exercises, is designed to help students test their 
comprehension and study for exams. 


CHANGES IN THE NEW EDITION 


The eighth edition continues the evolution and fine tuning of the text. It includes 
new problems, exercises, and text material chosen both for its inherent interest and 
for its use in building student intuition about probability. Illustrative of these goals 
are Example 5d of Chapter 1 on knockout tournaments, and Examples 4k and 5i of 
Chapter 7 on multiple player gambler’s ruin problems. 

A key change in the current edition is that the important result that the expectation 
of a sum of random variables is equal to the sum of the expectations is now first 
presented in Chapter 4 (rather than Chapter 7 as in previous editions). A new and 
elementary proof of this result when the sample space of the probability experiment 
is finite is given in this chapter. 

Another change is the expansion of Section 6.3, which deals with the sum of inde- 
pendent random variables. Section 6.3.1 is a new section in which we derive the 
distribution of the sum of independent and identically distributed uniform random 
variables, and then use our results to show that the expected number of random num- 
bers that needs to be added for their sum to exceed 1 is equal to e. Section 6.3.5 is a 
new section in which we derive the distribution of the sum of independent geometric 
random variables with different means. 
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CHAPTER 1 


Combinatorial Analysis 


1.1 
1.2 
1.3 
1.4 
1.5 
1.6 


1.1 


INTRODUCTION 


THE BASIC PRINCIPLE OF COUNTING 


PERMUTATIONS 
COMBINATIONS 


MULTINOMIAL COEFFICIENTS 


-.6 THE NUMBER OF INTEGER SOLUTIONS OF EQUATIONS 


INTRODUCTION 


Here is a typical problem of interest involving probability: A communication system 
is to consist of n seemingly identical antennas that are to be lined up in a linear order. 
The resulting system will then be able to receive all incoming signals—and will be 
called functional—as long as no two consecutive antennas are defective. If it turns 
out that exactly m of the n antennas are defective, what is the probability that the 
resulting system will be functional? For instance, in the special case where n = 4 and 
m = 2, there are 6 possible system configurations, namely, 


0110 


where 1 means that the antenna is working and 0 that it is defective. Because the 
resulting system will be functional in the first 3 arrangements and not functional in 
the remaining 3, it seems reasonable to take 2 = } as the desired probability. In 
the case of general m and m, we could compute the probability that the system is 
functional in a similar fashion. That is, we could count the number of configurations 
that result in the system’s being functional and then divide by the total number of all 
possible configurations. 

From the preceding discussion, we see that it would be useful to have an effective 
method for counting the number of ways that things can occur. In fact, many prob- 
lems in probability theory can be solved simply by counting the number of different 
ways that a certain event can occur. The mathematical theory of counting is formally 


known as combinatorial analysis. 


1.2 THE BASIC PRINCIPLE OF COUNTING 


The basic principle of counting will be fundamental to all our work. Loosely put, it 
states that if one experiment can result in any of m possible outcomes and if another 
experiment can result in any of n possible outcomes, then there are mn possible out- 
comes of the two experiments. 


2 Chapter 1 


Combinatorial Analysis 


The basic principle of counting 


Suppose that two experiments are to be performed. Then if experiment 1 can result 
in any one of m possible outcomes and if, for each outcome of experiment 1, there 
are n possible outcomes of experiment 2, then together there are mn possible out- 
comes of the two experiments. 


Proof of the Basic Principle: The basic principle may be proven by enumerating all 
the possible outcomes of the two experiments; that is, 


(1,1), 0,2), ..., d,n) 
(2,1), (2,2), ..., 2,n) 


(m,1), (m,2), ..., (m,n) 


where we say that the outcome is (i, /) if experiment 1 results in its ith possible out- 
come and experiment 2 then results in its jth possible outcome. Hence, the set of 
possible outcomes consists of m rows, each containing n elements. This proves the 
result. 


EXAMPLE 2a 


A small community consists of 10 women, each of whom has 3 children. If one woman 
and one of her children are to be chosen as mother and child of the year, how many 
different choices are possible? 


Solution. By regarding the choice of the woman as the outcome of the first experi- 
ment and the subsequent choice of one of her children as the outcome of the second 
experiment, we see from the basic principle that there are 10 X 3 = 30 possible 
choices. a 


When there are more than two experiments to be performed, the basic principle 
can be generalized. 


The generalized basic principle of counting 


If r experiments that are to be performed are such that the first one may result in 
any of 11 possible outcomes; and if, for each of these n; possible outcomes, there 
are nz possible outcomes of the second experiment; and if, for each of the possible 
outcomes of the first two experiments, there are n3 possible outcomes of the third 
experiment; and if ..., then there is a total of m, - n2---n; possible outcomes of the 
r experiments. 


EXAMPLE 26 


A college planning committee consists of 3 freshmen, 4 sophomores, 5 juniors, and 2 
seniors. A subcommittee of 4, consisting of 1 person from each class, is to be chosen. 
How many different subcommittees are possible? 


Section 1.3 Permutations 3 


Solution. We may regard the choice of a subcommittee as the combined outcome of 
the four separate experiments of choosing a single representative from each of the 
classes. It then follows from the generalized version of the basic principle that there 
are3 X 4 X 5 X 2 = 120 possible subcommittees. | 


EXAMPLE 2c 


How many different 7-place license plates are possible if the first 3 places are to be 
occupied by letters and the final 4 by numbers? 


Solution. By the generalized version of the basic principle, the answer is 26 - 26 - 


26-10-10. 10 - 10 = 175,760,000. a 
EXAMPLE 2d 

How many functions defined on n points are possible if each functional value is either 
0 or 1? 


Solution. Let the points be 1,2,...,n. Since f(i) must be either 0 or 1 for each i = 
1,2,...,n, it follows that there are 2” possible functions. | 


EXAMPLE 2e 


In Example 2c, how many license plates would be possible if repetition among letters 
or numbers were prohibited? 


Solution. In this case, there would be 26 - 25 - 24 -10-9- 8. 7 = 78,624,000 
possible license plates. | 


1.3. PERMUTATIONS 


How many different ordered arrangements of the letters a, b, and c are possible? By 
direct enumeration we see that there are 6, namely, abc, acb, bac, bca, cab, and cba. 
Each arrangement is known as a permutation. Thus, there are 6 possible permutations 
of a set of 3 objects. This result could also have been obtained from the basic principle, 
since the first object in the permutation can be any of the 3, the second object in the 
permutation can then be chosen from any of the remaining 2, and the third object 
in the permutation is then the remaining 1. Thus, there are 3 - 2 - 1 = 6 possible 
permutations. 

Suppose now that we have n objects. Reasoning similar to that we have just used 
for the 3 letters then shows that there are 


n(n — 1)\(n — 2)---3-2-1=n! 
different permutations of the n objects. 


EXAMPLE 3a 


How many different batting orders are possible for a baseball team consisting of 9 
players? 


Solution. There are 9! = 362,880 possible batting orders. | 


4 Chapter 1 


Combinatorial Analysis 


EXAMPLE 3b 


A class in probability theory consists of 6 men and 4 women. An examination is given, 
and the students are ranked according to their performance. Assume that no two 
students obtain the same score. 


(a) How many different rankings are possible? 


(b) If the men are ranked just among themselves and the women just among them- 
selves, how many different rankings are possible? 


Solution. (a) Because each ranking corresponds to a particular ordered arrangement 
of the 10 people, the answer to this part is 10! = 3,628,800. 

(b) Since there are 6! possible rankings of the men among themselves and 4! possi- 
ble rankings of the women among themselves, it follows from the basic principle that 
there are (6!)(4!) = (720)(24) = 17,280 possible rankings in this case. 


EXAMPLE 3c 


Ms. Jones has 10 books that she is going to put on her bookshelf. Of these, 4 are 
mathematics books, 3 are chemistry books, 2 are history books, and 1 is a language 
book. Ms. Jones wants to arrange her books so that all the books dealing with the 
same subject are together on the shelf. How many different arrangements are 
possible? 


Solution. There are 4! 3! 2! 1! arrangements such that the mathematics books are 
first in line, then the chemistry books, then the history books, and then the language 
book. Similarly, for each possible ordering of the subjects, there are 4! 3! 2! 1! possible 
arrangements. Hence, as there are 4! possible orderings of the subjects, the desired 
answer is 4! 4! 3! 2! 1! = 6912. | 


We shall now determine the number of permutations of a set of nm objects when cer- 
tain of the objects are indistinguishable from each other. To set this situation straight 
in our minds, consider the following example. 


EXAMPLE 3d 


How many different letter arrangements can be formed from the letters PEPPER? 


Solution. We first note that there are 6! permutations of the letters P) F,P2P3E2R 
when the 3P’s and the 2E’s are distinguished from each other. However, consider 
any one of these permutations—for instance, P; P) FE, P3E2R. If we now permute the 
P’s among themselves and the E’s among themselves, then the resultant arrangement 
would still be of the form PPEPER. That is, all 3! 2! permutations 


are of the form PPEPER. Hence, there are 6!/(3! 2!) = 60 possible letter arrange- 


P| PE, P3E,R  PP)E,P3E,R 
P| P3E|P.E.R  PP3E,P2E,R 
P>P\E,P3E.R P>P,E,P3E,R 
P>P3E\P\ E.R P)P3E,P\ ER 
P3P\E|P.E.R P3P\E,P2E|R 
P3PE,P{E,R P3P)E,P\E,R 


ments of the letters PEPPER. 
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In general, the same reasoning as that used in Example 3d shows that there are 


n! 
ny! ng! +++ ny! 
different permutations of 1 objects, of which n, are alike, m2 are alike, ...,; are 
alike. 
EXAMPLE 3e 


A chess tournament has 10 competitors, of which 4 are Russian, 3 are from the United 
States, 2 are from Great Britain, and 1 is from Brazil. If the tournament result lists just 
the nationalities of the players in the order in which they placed, how many outcomes 
are possible? 


Solution. There are a 
7 TET ae iad 


possible outcomes. a 


EXAMPLE 3f 


How many different signals, each consisting of 9 flags hung in a line, can be made 
from a set of 4 white flags, 3 red flags, and 2 blue flags if all flags of the same color are 


identical? 
Solution. There are a 
ETT = 1260 
different signals. a 


1.4 COMBINATIONS 


We are often interested in determining the number of different groups of r objects 
that could be formed from a total of n objects. For instance, how many different 
groups of 3 could be selected from the 5 items A, B, C, D, and E? To answer this 
question, reason as follows: Since there are 5 ways to select the initial item, 4 ways to 
then select the next item, and 3 ways to select the final item, there are thus 5 - 4 - 3 
ways of selecting the group of 3 when the order in which the items are selected is 
relevant. However, since every group of 3—say, the group consisting of items A, B, 
and C—will be counted 6 times (that is, all of the permutations ABC, ACB, BAC, 
BCA, CAB, and CBA will be counted when the order of selection is relevant), it 
follows that the total number of groups that can be formed is 

5-4-3 

i oo a - 
In general, as n(n — 1)---(” — r + 1) represents the number of different ways that a 
group of r items could be selected from n items when the order of selection is relevant, 
and as each group of r items will be counted r! times in this count, it follows that the 
number of different groups of r items that could be formed from a set of n items is 


HY = Neer Ge Pe TI) n! 
r! ~~ (n—vnir! 
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Notation and terminology 


We define (7 ).tor =n, by 


n _ n! 
(")-- a 


and say that ) represents the number of possible combinations of n objects 


taken r at a time.’ 


Thus, & represents the number of different groups of size r that could be 


selected from a set of n objects when the order of selection is not considered relevant. 


EXAMPLE 4a 


A committee of 3 is to be formed from a group of 20 people. How many different 
committees are possible? 


= 1140 possible committees. | 


Solution. There are (3) _ 20-19 - 18 


a) 342-4 


EXAMPLE 4b 


From a group of 5 women and 7 men, how many different committees consisting of 
2 women and 3 men can be formed? What if 2 of the men are feuding and refuse to 
serve on the committee together? 


Solution. As there are (3) possible groups of 2 women, and € possible 


groups of 3 men, it follows from the basic principle that there are (3) @ = 


(5 +) : ° ° = 350 possible committees consisting of 2 women and 3 men. 

Now suppose that 2 of the men refuse to serve together. Because a total of 
(3) (;) = 5 out of the € = 35 possible groups of 3 men contain both of 
the feuding men, it follows that there are 35 — 5 = 30 groups that do not contain 
both of the feuding men. Because there are still : = 10 ways to choose the 2 


women, there are 30 - 10 = 300 possible committees in this case. 


TBy convention, 0! is defined to be 1. Thus, ( ‘ = ( 4 = 1. We also take ( : to be equal 
to 0 when eitheri < Oori > n. 
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EXAMPLE 4c 


Consider a set of m antennas of which m are defective and n — m are functional 
and assume that all of the defectives and all of the functionals are considered indis- 
tinguishable. How many linear orderings are there in which no two defectives are 
consecutive? 


Solution. Imagine that the n — m functional antennas are lined up among them- 
selves. Now, if no two defectives are to be consecutive, then the spaces between the 
functional antennas must each contain at most one defective antenna. That is, in the 
n — m + 1 possible positions—represented in Figure 1.1 by carets—between the 
n — m functional antennas, we must select m of these in which to put the defective 
n—-m+1 
m 
least one functional antenna between any two defective ones. a 


antennas. Hence, there are ) possible orderings in which there is at 


aAlalal.salala 


1 = functional 


a = place for at most one defective 


FIGURE 1.1: No consecutive defectives 


A useful combinatorial identity is 


()=-(ri)+("7?) l=r=n (4.1) 


Equation (4.1) may be proved analytically or by the following combinatorial argu- 
ment: Consider a group of n objects, and fix attention on some particular one of these 
objects—call it object 1. Now, there are . = i groups of size r that contain object 
1 (since each such group is formed by selecting r — 1 from the remaining n — 1 


objects). Also, there are : i : ) groups of size r that do not contain object 1. As 
there is a total of ( ‘ ) groups of size r, Equation (4.1) follows. 


n ; : : 
The values , ) are often referred to as binomial coefficients because of their 


prominence in the binomial theorem. 


The binomial theorem 


ety =>) ( : ) a le (4.2) 


We shall present two proofs of the binomial theorem. The first is a proof by math- 
ematical induction, and the second is a proof based on combinatorial considerations. 
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Proof of the Binomial Theorem by Induction: Whenzn = 1, Equation (4.2) reduces to 


1 1 
vty=(Q)a% + ({ )#y°=y + x 


Assume Equation (4.2) forn — 1. Now, 


(t+ y"=@4+y@+ yy" 
= (x +o("Z ") sty k.n- 1-— k 
5 ("; 1) re ("T1) ke nak 
= k y k jr 
k=0 k=0 


Letting i= k + 1 in the first sum andi = k in the second sum, we find that 


ve EOD BCT or 


i=1 


n 
nN i n— 
= ( i soe i 
i=0 


where the next-to-last equality follows by Equation (4.1). By induction, the theorem 
is now proved. 


Combinatorial Proof of the Binomial Theorem: Consider the product 


(41 + yi)(%2 + y2)-++ Gn + Yn) 


Its expansion consists of the sum of 2” terms, each term being the product of n factors. 
Furthermore, each of the 2” terms in the sum will contain as a factor either x; or y; 
for eachi = 1,2,...,n. For example, 


(x1 + yi)(x2 + yo) = xX1x2 + X1y2 + yix2 + yiy2 


Now, how many of the 2” terms in the sum will have k of the x;’s and (n — k) of the y,’s 
as factors? As each term consisting of k of the x;’s and (n — k) of the y;’s corresponds 
to a choice of a group of k from the n values x1, x2,...,Xn, there are such terms. 


Thus, letting x; = x, yj = y,i=1,...,n, we see that 


k=0 
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EXAMPLE 4d 
Expand (x + y)?. 
Solution. 
3 3 3 a 
coor )er(I% (2) 
=y + 3xy? + 3x*y + a 
EXAMPLE 4e 


How many subsets are there of a set consisting of n elements? 


Solution. Since there are ( ‘ ) subsets of size k, the desired answer is 


Y(i)=4 + 1)"=2" 


k=0 


This result could also have been obtained by assigning either the number 0 or the 
number 1 to each element in the set. To each assignment of numbers, there corre- 
sponds, in a one-to-one fashion, a subset, namely, that subset consisting of all ele- 
ments that were assigned the value 1. As there are 2” possible assignments, the result 
follows. 

Note that we have included the set consisting of 0 elements (that is, the null set) 
as a subset of the original set. Hence, the number of subsets that contain at least one 
element is 2” — 1. | 


1.5 MULTINOMIAL COEFFICIENTS 


In this section, we consider the following problem: A set of n distinct items is to be 
divided into r distinct groups of respective sizes 11,n2,...,N;, Where )-;_, ni = Nn. 
How many different divisions are possible? To answer this question, we note that 


there are ( My ) possible choices for the first group; for each choice of the first group, 


there are & - ma ) possible choices for the second group; for each choice of the 


first two groups, there are 7 7 =e possible choices for the third group; and 
13 

so on. It then follows from the generalized version of the basic counting principle that 
there are 

n i — Hy nN ny ny Ny—1 

ny ny Ny 

_ n! (n — ny)! (n — ny — no “++ — n,_1)! 

~ (n — ny)!n!(n — ny — ny)! ny! 0! n,! 


n! 


~ ny! ng!---n,! 


possible divisions. 
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Another way to see this result is to consider the n values 1,1,...,1,2,...,2,..., 
r,...,/, where i appears nj; times, for i = 1,...,7. Every permutation of these values 
corresponds to a division of the n items into the r groups in the following manner: 
Let the permutation (1, i2,...,i, correspond to assigning item 1 to group i1, item 2 to 
group iz, and so on. For instance, if nm = 8 and ifm, = 4, no = 3, and n3 = 1, then 
the permutation 1,1,2,3,2,1,2,1 corresponds to assigning items 1,2,6,8 to the first 
group, items 3,5,7 to the second group, and item 4 to the third group. Because every 
permutation yields a division of the items and every possible division results from 
some permutation, it follows that the number of divisions of n items into r distinct 


groups of sizes n1,/2,...,n, is the same as the number of permutations of n items of 

which 7 are alike, and mp are alike, ..., and n; are alike, which was shown in Section 
n!} 

1.3 to equal 


ny!nz!---n,! 


Notation 


n 
ai lke: cil mya mwe define (yy, 4, ) BY 


n _ n! 
ny,N2,...,Ny ny! ny! +++ n,! 


Thus, ( - n, } tepresents the number of possible divisions of n distinct 
e) graces g FEF 
objects into r distinct groups of respective sizes 11,/2,...,Mr- 
EXAMPLE 5a 


A police department in a small city consists of 10 officers. If the department policy is 
to have 5 of the officers patrolling the streets, 2 of the officers working full time at the 
station, and 3 of the officers on reserve at the station, how many different divisions of 
the 10 officers into the 3 groups are possible? 


Solution. There are = 2520 possible divisions. | 


10! 
5! 2! 3! 
EXAMPLE 5b 


Ten children are to be divided into an A team and a B team of 5 each. The A team 
will play in one league and the B team in another. How many different divisions are 
possible? 


10! 
Solution. There are 3151 = 252 possible divisions. a 


EXAMPLE 5c 


In order to play a game of basketball, 10 children at a playground divide themselves 
into two teams of 5 each. How many different divisions are possible? 
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Solution. Note that this example is different from Example 5b because now the order 
of the two teams is irrelevant. That is, there is no A and B team, but just a division 
consisting of 2 groups of 5 each. Hence, the desired answer is 


101/(5! 5!) 


oy = 126 | 


The proof of the following theorem, which generalizes the binomial theorem, is 
left as an exercise. 


The multinomial theorem 


n \S- n ny Nz Ny 

x xX eee x = XX 2X 

las 2+ t ) Gas a) I 2 if 
(n,...,My): 


mts: +n=n 


That is, the sum is over all nonnegative integer-valued vectors (11,n2,...,n;) such 
thatn, + m9 +--+ +n =n. 


n 


The numbers 
ny,N2,...,Mr 


) are known as multinomial coefficients. 


EXAMPLE 5d 


In the first round of a knockout tournament involving n = 2” players, the n players 
are divided into n/2 pairs, with each of these pairs then playing a game. The losers 
of the games are eliminated while the winners go on to the next round, where the 
process is repeated until only a single player remains. Suppose we have a knockout 
tournament of 8 players. 


(a) How many possible outcomes are there for the initial round? (For instance, one 
outcome is that 1 beats 2, 3 beats 4, 5 beats 6, and 7 beats 8. ) 

(b) How many outcomes of the tournament are possible, where an outcome gives 
complete information for all rounds? 


Solution. One way to determine the number of possible outcomes for the initial 
round is to first determine the number of possible pairings for that round. To do 
so, note that the number of ways to divide the 8 players into a first pair, a second pair, 


8 8! 
a third pair, and a fourth pair is ( 2,2,2,2 = 5a" Thus, the number of possible pair- 
ings when there is no ordering of the 4 pairs is aay For each such pairing, there are 


2 possible choices from each pair as to the winner of that game, showing that there 
i248! 

e ma a possible results of round 1. (Another way to see this is to note that 

there are 6 possible choices of the 4 winners and, for each such choice, there are 

8! 

4! 


ar 


8 
4! ways to pair the 4 winners with the 4 losers, showing that there are 4! ( ) = 


possible results for the first round.) 
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4! 
Similarly, for each result of round 1, there are TT possible outcomes of round 2, 


and for each of the outcomes of the first two rounds, there are a possible outcomes 
of round 3. Consequently, by the generalized basic principle of counting, there are 


8! 4! 2! ' 

cc Tae 8! possible outcomes of the tournament. Indeed, the same argument 
can be used to show that a knockout tournament of n = 2” players has n! possible 
outcomes. 


Knowing the preceding result, it is not difficult to come up with a more direct 
argument by showing that there is a one-to-one correspondence between the set of 
possible tournament results and the set of permutations of 1,...,”. To obtain such 
a correspondence, rank the players as follows for any tournament result: Give the 
tournament winner rank 1, and give the final-round loser rank 2. For the two play- 
ers who lost in the next-to-last round, give rank 3 to the one who lost to the player 
ranked 1 and give rank 4 to the one who lost to the player ranked 2. For the four 
players who lost in the second-to-last round, give rank 5 to the one who lost to player 
ranked 1, rank 6 to the one who lost to the player ranked 2, rank 7 to the one who 
lost to the player ranked 3, and rank 8 to the one who lost to the player ranked 4. 
Continuing on in this manner gives a rank to each player. (A more succinct descrip- 
tion is to give the winner of the tournament rank 1 and let the rank of a player who 
lost in a round having 2* matches be 2* plus the rank of the player who beat him, for 
k = 0,...,m — 1.) In this manner, the result of the tournament can be represented 
by a permutation /1,i2,...,i,, where i; is the player who was given rank j. Because 
different tournament results give rise to different permutations, and because there is 
a tournament result for each permutation, it follows that there are the same number 
of possible tournament results as there are permutations of 1,...,n. fe 


EXAMPLE 5e 
2 2, 
(xy + x2 + x3)? = é 0,0 ) X{X9X3 + « 2.0 ) X1X5X3 
2 0.0.2 2 1,1,0 
T 6 ee ) X4%9%3 1 1,1,0 4 X9%X3 


2 1.0.1 2 O44 
on (4.01) 84 Tr (oi ates 


=x + ie + < + 2x1x2 + 2x1x3 + 2x2%x3 | 


*1.6 THE NUMBER OF INTEGER SOLUTIONS OF EQUATIONS 


There are 7” possible outcomes when n distinguishable balls are to be distributed into 
r distinguishable urns. This result follows because each ball may be distributed into 
any of r possible urns. Let us now, however, suppose that the n balls are indistinguish- 
able from each other. In this case, how many different outcomes are possible? As the 
balls are indistinguishable, it follows that the outcome of the experiment of distribut- 
ing the v balls into r urns can be described by a vector (x1,X2,...,x,), where x; denotes 
the number of balls that are distributed into the ith urn. Hence, the problem reduces 
to finding the number of distinct nonnegative integer-valued vectors (x1,x2,...,Xr) 
such that 
Xp + XQ +++ + Xp HN 


* Asterisks denote material that is optional. 
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To compute this number, let us start by considering the number of positive integer- 
valued solutions. Toward that end, imagine that we have n indistinguishable objects 
lined up and that we want to divide them into r nonempty groups. To do so, we can 
select r — 1 of then — 1 spaces between adjacent objects as our dividing points. (See 
Figure 1.2.) For instance, if we have n = 8 and r = 3 and we choose the 2 divisors so 
as to obtain 

000|000|00 


OvnadDna0an...a0ad 


n objects 0 


Choose r — 1 of the spaces a. 


FIGURE 1.2: Number of positive solutions 


then the resulting vector is xj = 3,x2 = 3,x3 = 2. As there are € 7 : ) possible 


selections, we have the following proposition. 


Proposition 6.1. There are & 7 ' ) distinct positive integer-valued vectors (x1, 


x2,...,X;) satisfying the equation 
tro te +x, =n xX > O7=1,...,r 


To obtain the number of nonnegative (as opposed to positive) solutions, note 


that the number of nonnegative solutions of xj + x2. + --- + x, = nis the same 
as the number of positive solutions of yj + --- + y, = n + r (seen by letting 
yj = x + 1, i = 1,...,r). Hence, from Proposition 6.1, we obtain the following 
proposition. 
OF: n+r-1 thas won 

Proposition 6.2. There are ee | distinct nonnegative integer-valued vec- 
tors (x1,%2,...,X,) Satisfying the equation 

Xp fxg +--+ +x HN (6.1) 
EXAMPLE 6a 
How many distinct nonnegative integer-valued solutions of x, + x2 = 3 are possible? 

. 342-1 

Solution. There are >] = 4 such solutions: (0, 3), (1, 2), (2, 1), (3,0). 


EXAMPLE 6b 


An investor has 20 thousand dollars to invest among 4 possible investments. Each 
investment must be in units of a thousand dollars. If the total 20 thousand is to be 
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invested, how many different investment strategies are possible? What if not all the 
money need be invested? 


Solution. If we let xj,i = 1, 2, 3, 4, denote the number of thousands invested in 
investment 7, then, when all is to be invested, x1,x2,x3,x4 are integers satisfying the 
equation 


yy tx + 434+ x%4=20 x, = 0 


Hence, by Proposition 6.2, there are = 1771 possible investment strategies. If 


23 
3 
not all of the money need be invested, then if we let x5 denote the amount kept in 
reserve, a strategy is a nonnegative integer-valued vector (x1, X2,x3,%4,X5) satisfying 


the equation 


xy + x2 + x3 + x4 + X5 = 20 


Hence, by Proposition 6.2, there are now ( . ) = 10,626 possible strategies. | 


EXAMPLE 6c 


How many terms are there in the multinomial expansion of (x; + x2 + --- + x;)"? 


Solution. 


1 + x2 + °°: += (, a ny ) Moa 


where the sum is over all nonnegative integer-valued (71,...,,) such that nm, + --- + 
n, = n. Hence, by Proposition 6.2, there are ( e . i é ; ) such terms. | 
EXAMPLE 6d 


Let us consider again Example 4c, in which we have a set of n items, of which m are 
(indistinguishable and) defective and the remaining n — m are (also indistinguishable 
and) functional. Our objective is to determine the number of linear orderings in which 
no two defectives are next to each other. To determine this number, let us imagine 
that the defective items are lined up among themselves and the functional ones are 
now to be put in position. Let us denote x; as the number of functional items to the 
left of the first defective, x2 as the number of functional items between the first two 
defectives, and so on. That is, schematically, we have 


X1 0x2 0+ ++ Xm OXm41 


Now, there will be at least one functional item between any pair of defectives as long 
asx; > 0,i=2,...,m. Hence, the number of outcomes satisfying the condition is the 
number of vectors x1,...,Xm4+1 that satisfy the equation 


Xp tee + Xm Hn-—m x 20, X41 = 0, x) > 0, 7=2,...,m 


Summary 15 


But, on letting yy) = x1 + Ly = x,7 = 2,...,M,¥m41 = Xm41 + 1, we see that 
this number is equal to the number of positive vectors (y1,...,¥m41) that satisfy the 
equation 

Mot yo ++ + Vm 1 =n-— m+ 2 


= — 1 : 
Hence, by Proposition 6.1, there are (" mn * ) such outcomes, in agreement 


with the results of Example 4c. 

Suppose now that we are interested in the number of outcomes in which each pair 
of defective items is separated by at least 2 functional items. By the same reason- 
ing as that applied previously, this would equal the number of vectors satisfying the 
equation 


Xp te + Xm =Hn—-—m x = 0, Xmy1 = 0, x) = 2,1=2,...,m 


Upon letting y) = x, + 1l,yj = x; — 1,1 = 2,...,M,¥n41 = Xm41 + 1, we see that 
this is the same as the number of positive solutions of the equation 


Vito + IYmy1 =n — 2m + 3 


n—-22m4+2 


Hence, from Proposition 6.1, there are ( 


) such outcomes. | 


SUMMARY 


The basic principle of counting states that if an experiment consisting of two phases is 
such that there are n possible outcomes of phase 1 and, for each of these n outcomes, 
there are m possible outcomes of phase 2, then there are nm possible outcomes of the 


experiment. 

There are n! = n(n — 1)---3 - 2 - 1 possible linear orderings of n items. The 
quantity 0! is defined to equal 1. 

Let 


em 
i] gee HG 


when 0 = i = n, and let it equal 0 otherwise. This quantity represents the number 
of different subgroups of size i that can be chosen from a set of size n. It is often 
called a binomial coefficient because of its prominence in the binomial theorem, which 
states that 


(x + yy” = > Ca 


i=0 


For nonnegative integers 71,...,, Summing to n, 


n n! 
N1,N2,...,Mr ~ nytng!---ny! 


is the number of divisions of n items into r distinct nonoverlapping subgroups of sizes 
n1,N2,...,Mr. 
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PROBLEMS 


. (a) How many different 7-place license plates are 
possible if the first 2 places are for letters and 
the other 5 for numbers? 

(b) Repeat part (a) under the assumption that no 
letter or number can be repeated in a single 
license plate. 

. How many outcome sequences are possible when a 
die is rolled four times, where we say, for instance, 
that the outcome is 3, 4, 3, 1 if the first roll landed 
on 3, the second on 4, the third on 3, and the fourth 
on 1? 
. Twenty workers are to be assigned to 20 different 
jobs, one to each job. How many different assign- 
ments are possible? 
. John, Jim, Jay, and Jack have formed a band con- 
sisting of 4 instruments. If each of the boys can play 
all 4 instruments, how many different arrange- 
ments are possible? What if John and Jim can play 
all 4 instruments, but Jay and Jack can each play 
only piano and drums? 

. For years, telephone area codes in the United 

States and Canada consisted of a sequence of three 

digits. The first digit was an integer between 2 and 

9, the second digit was either 0 or 1, and the third 

digit was any integer from 1 to 9. How many area 

codes were possible? How many area codes start- 


ing with a 4 were possible? 

. A well-known nursery rhyme starts as follows: 

“As I was going to St. Ives 

I met a man with 7 wives. 

Each wife had 7 sacks. 

Each sack had 7 cats. 

Each cat had 7 kittens...” 

How many kittens did the traveler meet? 

- (a) In how many ways can 3 boys and 3 girls sit in 
a row? 

(b) In how many ways can 3 boys and 3 girls sit in 
a row if the boys and the girls are each to sit 
together? 

(c) In how many ways if only the boys must sit 
together? 

(d) In how many ways if no two people of the 
same sex are allowed to sit together? 

. How many different letter arrangements can be 

made from the letters 

(a) Fluke? 

(b) Propose? 

(c) Mississippi? 

(d) Arrange? 

. A child has 12 blocks, of which 6 are black, 4 are 

red, 1 is white, and 1 is blue. If the child puts the 

blocks in a line, how many arrangements are pos- 
sible? 


10. 


11. 


12. 


13. 


14. 
15. 


16. 


17. 


18. 


19. 


In how many ways can 8 people be seated in a 

row if 

(a) there are no restrictions on the seating 
arrangement? 

(b) persons A and B must sit next to each other? 

(c) there are 4 men and 4 women and no 2 men 
or 2 women can sit next to each other? 

(d) there are 5 men and they must sit next to each 
other? 

(e) there are 4 married couples and each couple 
must sit together? 

In how many ways can 3 novels, 2 mathematics 

books, and 1 chemistry book be arranged on a 

bookshelf if 

(a) the books can be arranged in any order? 

(b) the mathematics books must be together and 
the novels must be together? 

(c) the novels must be together, but the other 
books can be arranged in any order? 

Five separate awards (best scholarship, best lead- 

ership qualities, and so on) are to be presented to 

selected students from a class of 30. How many dif- 

ferent outcomes are possible if 

(a) astudent can receive any number of awards? 

(b) each student can receive at most | award? 

Consider a group of 20 people. If everyone shakes 

hands with everyone else, how many handshakes 

take place? 

How many 5-card poker hands are there? 

A dance class consists of 22 students, of which 10 

are women and 12 are men. If 5 men and 5 women 

are to be chosen and then paired off, how many 

results are possible? 

A student has to sell 2 books from a collection of 

6 math, 7 science, and 4 economics books. How 

many choices are possible if 

(a) both books are to be on the same subject? 

(b) the books are to be on different subjects? 

Seven different gifts are to be distributed among 

10 children. How many distinct results are possible 

if no child is to receive more than one gift? 

A committee of 7, consisting of 2 Republicans, 

2 Democrats, and 3 Independents, is to be cho- 

sen from a group of 5 Republicans, 6 Democrats, 

and 4 Independents. How many committees are 

possible? 

From a group of 8 women and 6 men, a committee 

consisting of 3 men and 3 women is to be formed. 

How many different committees are possible if 

(a) 2 of the men refuse to serve together? 

(b) 2 of the women refuse to serve together? 

(c) 1 man and 1 woman refuse to serve together? 


20. 


21. 


A person has 8 friends, of whom 5 will be invited 

to a party. 

(a) How many choices are there if 2 of the friends 
are feuding and will not attend together? 

(b) How many choices if 2 of the friends will only 
attend together? 

Consider the grid of points shown here. Suppose 

that, starting at the point labeled A, you can go one 

step up or one step to the right at each move. This 

procedure is continued until the point labeled B is 

reached. How many different paths from A to B 

are possible? 

Hint: Note that to reach B from A, you must take 

4 steps to the right and 3 steps upward. 


@ @ @- @ @ 

e 2 e i @ 
A 
22. In Problem 21, how many different paths are there 


from A to B that go through the point circled in 
the following lattice? 


@ 

e @ ‘@- @ @ 
A e @ e © @ 
23. A psychology laboratory conducting dream 


research contains 3 rooms, with 2 beds in each 
room. If 3 sets of identical twins are to be assigned 
to these 6 beds so that each set of twins sleeps 


24. 
25. 


26. 
27. 


28. 


29. 


30. 


*31. 


*32. 


*33. 
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in different beds in the same room, how many 
assignments are possible? 
Expand (3x* + y)°. 
The game of bridge is played by 4 players, each of 
whom is dealt 13 cards. How many bridge deals are 
possible? 
Expand (x; + 2x2 + 3x3)4. 
If 12 people are to be divided into 3 committees of 
respective sizes 3, 4, and 5, how many divisions are 
possible? 
If 8 new teachers are to be divided among 4 
schools, how many divisions are possible? What if 
each school must receive 2 teachers? 
Ten weight lifters are competing in a team weight- 
lifting contest. Of the lifters, 3 are from the United 
States, 4 are from Russia, 2 are from China, and 1 
is from Canada. If the scoring takes account of the 
countries that the lifters represent, but not their 
individual identities, how many different outcomes 
are possible from the point of view of scores? How 
many different outcomes correspond to results in 
which the United States has 1 competitor in the 
top three and 2 in the bottom three? 
Delegates from 10 countries, including Russia, 
France, England, and the United States, are to 
be seated in a row. How many different seat- 
ing arrangements are possible if the French and 
English delegates are to be seated next to each 
other and the Russian and U.S. delegates are not 
to be next to each other? 
If 8 identical blackboards are to be divided among 
4 schools, how many divisions are possible? How 
many if each school must receive at least 1 black- 
board? 
An elevator starts at the basement with 8 peo- 
ple (not including the elevator operator) and dis- 
charges them all by the time it reaches the top 
floor, number 6. In how many ways could the oper- 
ator have perceived the people leaving the eleva- 
tor if all people look alike to him? What if the 8 
people consisted of 5 men and 3 women and the 
operator could tell a man from a woman? 
We have 20 thousand dollars that must be invested 
among 4 possible opportunities. Each investment 
must be integral in units of 1 thousand dollars, 
and there are minimal investments that need to be 
made if one is to invest in these opportunities. The 
minimal investments are 2, 2, 3, and 4 thousand 
dollars. How many different investment strategies 
are available if 
(a) an investment must be made in each opportu- 
nity? 
(b) investments must be made in at least 3 of the 
4 opportunities? 
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10. 


. Determine the number of vectors (x1,.. 


. How many vectors xj,. 


Combinatorial Analysis 


THEORETICAL EXERCISES 


. Prove the generalized version of the basic counting 


principle. 


. Two experiments are to be performed. The first 


can result in any one of m possible outcomes. If 
the first experiment results in outcome j, then the 
second experiment can result in any of n; possible 
outcomes, i = 1,2,...,m. What is the number of 
possible outcomes of the two experiments? 


. In how many ways can r objects be selected from a 


set of n objects if the order of selection is consid- 
ered relevant? 


n\,. ‘ 
. There are different linear arrangements of n 


balls of which r are black andn — rare white. Give 
a combinatorial explanation of this fact. 

. Xn), such 
that each x; is either 0 or 1 and 


n 
be: >k 
i=1 


..,Xx are there for which 
each x; is a positive integer such that 1 = xj =n 
and x, < x. <-:: < xx? 


. Give an analytic proof of Equation (4.1). 
. Prove that 


Cea (OF) (1) 


Hint: Consider a group of nm men and m women. 
How many groups of size r are possible? 


. Use Theoretical Exercise 8 to prove that 


(7)-D(z) 


From a group of n people, suppose that we want to 

choose a committee of k,k = n, one of whom is to 

be designated as chairperson. 

(a) By focusing first on the choice of the commit- 
tee and then on the choice of the chair, argue 


n 


that there are k k possible choices. 


(b) By focusing first on the choice of the 
nonchair committee members and then on 


11. 


12. 


the choice of the chair, argue that there are 
k - 1 (n — k + 1) possible choices. 


(c) By focusing first on the choice of the chair 
and then on the choice of the other ee 


members, argue that there are n (; = 1 


possible choices. 
(d) Conclude from parts (a), (b), and (c) that 


(s)eo-ten(ots)=(82} 


(e) Use the factorial definition of ( . ) to verify 


the identity in part (d). 
The following identity is known as Fermat’s com- 
binatorial identity: 


()-E (eri) =e 


Give a combinatorial argument (no computations 
are needed) to establish this identity. 

Hint: Consider the set of numbers 1 through n. 
How many subsets of size k have i as their highest- 
numbered member? 

Consider the following combinatorial identity: 


te i 

-1 
Ye (gan oe 
k=1 


(a) Present a combinatorial argument for this 
identity by considering a set of n people and 
determining, in two ways, the number of pos- 
sible selections of a committee of any size and 
a chairperson for the committee. 

Hint: 

(i) How many possible selections are there 
of a committee of size k and its chairper- 
son? 

(ii) How many possible selections are there 
of a chairperson and the other commit- 
tee members? 


(b) Verify the following identity for n = 
1,2,3,4, 5: 


S- (i )e = 2" n(n + 1) 


13. 


14. 


For a combinatorial proof of the preceding, 
consider a set of n people and argue that both 
sides of the identity represent the number of 
different selections of a committee, its chair- 
person, and its secretary (possibly the same as 
the chairperson). 

Hint: 

(i) How many different selections result in 
the committee containing exactly k peo- 
ple? 

(ii) How many different selections are there 
in which the chairperson and the secre- 
tary are the same? (ANSWER: n2”~!.) 

(iii) How many different selections result in 
the chairperson and the secretary being 
different? 


(c) Now argue that 


n 


> ( : ) 3 =2"-372(n + 3) 


k=1 


Show that, forn > 0, 


yen'(7)=0 


i=0 


Hint: Use the binomial theorem. 

From a set of 7 people, a committee of size j is to be 

chosen, and from this committee, a subcommittee 

of size i,i = j, 1s also to be chosen. 

(a) Derive a combinatorial identity by comput- 
ing, in two ways, the number of possible 
choices of the committee and subcommittee— 
first by supposing that the committee is 
chosen first and then the subcommittee is 
chosen, and second by supposing that the 
subcommittee is chosen first and then the 
remaining members of the committee are 
chosen. 

(b) Use part (a) to prove the following combina- 
torial identity: 


(7)()=(1)e ose 


(c) Use part (a) and Theoretical Exercise 13 to 
show that 


(5) ()Jows-0 ros 
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15. Let H;(n) be the number of vectors x1,...,x, for 


which each x; is a positive integer satisfying 1 = 
xj Snandx Sx. S--- = XxX. 
(a) Without any computations, argue that 


Ay(n) =n 


Ayn) = 0 Apa) k > 1 
j=l 


Hint: How many vectors are there in which 
Xk = p? 

(b) Use the preceding recursion to compute 
H;3(5). 
Hint: First compute H2(n) for n = 1, 2, 3, 4, 5. 


16. Consider a tournament of n contestants in which 


the outcome is an ordering of these contestants, 
with ties allowed. That is, the outcome partitions 
the players into groups, with the first group consist- 
ing of the players that tied for first place, the next 
group being those that tied for the next-best posi- 
tion, and so on. Let N(n) denote the number of dif- 
ferent possible outcomes. For instance, N(2) = 3, 
since, in a tournament with 2 contestants, player 1 
could be uniquely first, player 2 could be uniquely 
first, or they could tie for first. 

(a) List all the possible outcomes when n = 3. 


(b) With N(0) defined to equal 1, argue, without 
any computations, that 


n 


non = (4) Nm a 


i=] 


Hint: How many outcomes are there in 
which i players tie for last place? 


(c) Show that the formula of part (b) is equivalent 
to the following: 


n-1 
Nn) =)- ( : ) N(i) 


= 


(d) Use the recursion to find N(3) and N(4). 


17. Present a combinatorial explanation of why 


(7) =(an") 
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18. 


19. 
*20. 
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Argue that 
n _ n—-1 
Ny,N2,...,Ny ) \ ny — 1,no,...,ny 
n—-1 re 
ny,n2 — 1,...,ny _ 
n—-1 
ny,n2, sftp — 1 


Hint: Use an argument similar to the one used to 
establish Equation (4.1). 

Prove the multinomial theorem. 

In how many ways can n identical balls be dis- 
tributed into r urns so that the ith urn contains at 
least m; balls, for each i = 1,...,r? Assume that 


ey i 


*21. 


*22. 


*23. 


Argue that there are exactly ( ! ) ( . " 5 7 k ) 
solutions of 


Xi +X. +--+ + Xp Hn 


for which exactly k of the x; are equal to 0. 
Consider a function f(x1,...,X,) of n variables. 
How many different partial derivatives of order r 
does f possess? 

Determine the number of vectors (x1,.. 
that each x; is a nonnegative integer and 


.,Xn) such 


se =k 
1 


SELF-TEST PROBLEMS AND EXERCISES 


. How many different linear arrangements are there 


of the letters A, B, C, D, E, F for which 

(a) A and B are next to each other? 

(b) A is before B? 

(c) A is before B and B is before C? 

(d) A is before B and Cis before D? 

(e) A and B are next to each other and C and D 
are also next to each other? 

(f) Eis not last in line? 


. If 4 Americans, 3 French people, and 3 British 


people are to be seated in a row, how many seat- 
ing arrangements are possible when people of the 
same nationality must sit next to each other? 


. A president, treasurer, and secretary, all different, 


are to be chosen from a club consisting of 10 peo- 
ple. How many different choices of officers are 
possible if 

(a) there are no restrictions? 

(b) A and B will not serve together? 

(c) Cand D will serve together or not at all? 

(d) E must be an officer? 

(e) F will serve only if he is president? 


. A student is to answer 7 out of 10 questions in 


an examination. How many choices has she? How 
many if she must answer at least 3 of the first 5 
questions? 


. In how many ways can a man divide 7 gifts among 


his 3 children if the eldest is to receive 3 gifts and 
the others 2 each? 


. How many different 7-place license plates are pos- 


sible when 3 of the entries are letters and 4 are 
digits? Assume that repetition of letters and num- 
bers is allowed and that there is no restriction on 
where the letters or numbers can be placed. 


7. 


8. 


10. 


11. 


Give a combinatorial explanation of the identity 


Consider n-digit numbers where each digit is one 

of the 10 integers 0,1,...,9. How many such num- 

bers are there for which 

(a) no two consecutive digits are equal? 

(b) O appears as a digit a total of i times, i = 
On csgH? 


. Consider three classes, each consisting of n stu- 


dents. From this group of 37 students, a group of 3 

students is to be chosen. 

(a) How many choices are possible? 

(b) How many choices are there in which all 3 stu- 
dents are in the same class? 

(c) How many choices are there in which 2 of the 

3 students are in the same class and the other 

student is in a different class? 

How many choices are there in which all 3 stu- 

dents are in different classes? 

Using the results of parts (a) through (d), 

write a combinatorial identity. 

How many 5-digit numbers can be formed from 

the integers 1,2,...,9 if no digit can appear more 

than twice? (For instance, 41434 is not allowed.) 

From 10 married couples, we want to select a 

group of 6 people that is not allowed to contain 

a married couple. 

(a) How many choices are there? 

(b) How many choices are there if the group must 
also consist of 3 men and 3 women? 


(d) 
(e) 


12. 


*13. 


*14, 


15. 


A committee of 6 people is to be chosen from a 
group consisting of 7 men and 8 women. If the 
committee must consist of at least 3 women and 
at least 2 men, how many different committees are 
possible? 

An art collection on auction consisted of 4 Dalis, 5 
van Goghs, and 6 Picassos. At the auction were 5 
art collectors. If a reporter noted only the number 
of Dalis, van Goghs, and Picassos acquired by each 
collector, how many different results could have 
been recorded if all of the works were sold? 
Determine the number of vectors (x1,...,xX,) such 
that each x; is a positive integer and 


n 
ys =k 
1 


where k = n. 

A total of n students are enrolled in a review 
course for the actuarial examination in probability. 
The posted results of the examination will list the 
names of those who passed, in decreasing order of 
their scores. For instance, the posted result will be 
“Brown, Cho” if Brown and Cho are the only ones 
to pass, with Brown receiving the higher score. 


16. 


17. 


18. 


19. 
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Assuming that all scores are distinct (no ties), how 
many posted results are possible? 

How many subsets of size 4 of the set S$ = 
{1,2,...,20} contain at least one of the elements 
1,2,3,4,5? 

Give an analytic verification of 


n k n—k 
(s)=(:) she ("5") tskse 


Now, give a combinatorial argument for this 
identity. 

In a certain community, there are 3 families con- 
sisting of a single parent and 1 child, 3 families 
consisting of a single parent and 2 children, 5 fam- 
ilies consisting of 2 parents and a single child, 7 
families consisting of 2 parents and 2 children, and 
6 families consisting of 2 parents and 3 children. If 
a parent and child from the same family are to be 
chosen, how many possible choices are there? 

If there are no restrictions on where the digits and 
letters are placed, how many 8-place license plates 
consisting of 5 letters and 3 digits are possible if no 
repetitions of letters or digits are allowed. What if 
the 3 digits must be consecutive? 
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INTRODUCTION 


SAMPLE SPACE AND EVENTS 

AXIOMS OF PROBABILITY 

SOME SIMPLE PROPOSITIONS 

SAMPLE SPACES HAVING EQUALLY LIKELY OUTCOMES 
PROBABILITY AS A CONTINUOUS SET FUNCTION 
PROBABILITY AS A MEASURE OF BELIEF 


INTRODUCTION 


In this chapter, we introduce the concept of the probability of an event and then show 
how probabilities can be computed in certain situations. As a preliminary, however, 
we need the concept of the sample space and the events of an experiment. 


SAMPLE SPACE AND EVENTS 


Consider an experiment whose outcome is not predictable with certainty. However, 
although the outcome of the experiment will not be known in advance, let us suppose 
that the set of all possible outcomes is known. This set of all possible outcomes of 
an experiment is known as the sample space of the experiment and is denoted by S. 
Following are some examples: 


1. If the outcome of an experiment consists in the determination of the sex of a 


newborn child, then 
S = {g,b} 


where the outcome g means that the child is a girl and b that it is a boy. 


. If the outcome of an experiment is the order of finish in a race among the 7 


horses having post positions 1, 2, 3, 4, 5, 6, and 7, then 
S = {all 7! permutations of (1,2,3,4,5, 6, 7)} 


The outcome (2, 3, 1, 6, 5, 4, 7) means, for instance, that the number 2 horse 
comes in first, then the number 3 horse, then the number 1 horse, and so on. 


. If the experiment consists of flipping two coins, then the sample space consists 


of the following four points: 
S = ((H, 4), (4,7), (T,@),(7,TM)} 


The outcome will be (H, H) if both coins are heads, (H, T) if the first coin is 
heads and the second tails, (T, H) if the first is tails and the second heads, and 
(T, T) if both coins are tails. 
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4. If the experiment consists of tossing two dice, then the sample space consists of 
the 36 points 


S={(i, fii, j= 1, 2, 3, 4, 5, 6} 


where the outcome (i, /) is said to occur if i appears on the leftmost die and j on 
the other die. 

5. If the experiment consists of measuring (in hours) the lifetime of a transistor, 
then the sample space consists of all nonnegative real numbers; that is, 


S={x:0 =x < o} 


Any subset E of the sample space is known as an event. In other words, an event is 
a Set consisting of possible outcomes of the experiment. If the outcome of the experi- 
ment is contained in E, then we say that E has occurred. Following are some examples 
of events. 

In the preceding Example 1, if EF = {g}, then E is the event that the child is a girl. 
Similarly, if F = {b}, then F is the event that the child is a boy. 

In Example 2, if 


E = {all outcomes in S starting with a 3} 


then E is the event that horse 3 wins the race. 

In Example 3, if EF = {(H, H), (H,T)}, then E is the event that a head appears on 
the first coin. 

In Example 4, if FE = {(1, 6), (2,5), (3,4), (4,3), (6,2), (6, 1)}, then E is the event that 
the sum of the dice equals 7. 

In Example 5, if E = {x:0 = x = 5}, then E is the event that the transistor does 
not last longer than 5 hours. 

For any two events EF and F of a sample space S, we define the new event E U F 
to consist of all outcomes that are either in £ or in F or in both E and F. That is, the 
event E U F will occur if either E or F occurs. For instance, in Example 1, if event 
FE = {g} and F = {b}, then 


EU F = {g,b} 


That is, E U F is the whole sample space S. In Example 3, if EF = {(H, H), (H, T)} and 
F={(T,HA)}, then 


EU F={(A,#),(H,T),(T,H)} 


Thus, £ U F would occur if a head appeared on either coin. 

The event E U F is called the union of the event E and the event F. 

Similarly, for any two events EF and F, we may also define the new event EF, called 
the intersection of E and F, to consist of all outcomes that are both in E and in F. 
That is, the event EF (sometimes written E M F) will occur only if both EF and F 
occur. For instance, in Example 3, if E = {(H, H), (H,T), (T, H)} is the event that at 
least 1 head occurs and F = {(H,T),(T,H),(T,7T)} is the event that at least 1 tail 
occurs, then 


EF = {(Hf,T),(T, H)} 


is the event that exactly 1 head and 1 tail occur. In example 4, if EF = {(1,6), (2,5), 
(3,4), (4,3), (5,2), (6, 1)} is the event that the sum of the dice is 7 and F = {(1,5), (2,4), 
(3,3), (4,2), (5,1)} is the event that the sum is 6, then the event EF does not contain 
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any outcomes and hence could not occur. To give such an event a name, we shall refer 
to it as the null event and denote it by ©. (That is, @ refers to the event consisting of 
no outcomes.) If EF = @, then E and F are said to be mutually exclusive. 

We define unions and intersections of more than two events in a similar manner. 
If £1, E2,... are events, then the union of these events, denoted by J En, is defined 


n=1 
to be that event which consists of all outcomes that are in E,, for at least one value 


(oe) 
of n = 1,2,.... Similarly, the intersection of the events E,, denoted by () En, is 
n=1 
defined to be the event consisting of those outcomes which are in all of the events 


Ey,n = 1,2,.... 

Finally, for any event E, we define the new event E‘, referred to as the com- 
plement of E, to consist of all outcomes in the sample space S that are not in E. 
That is, E° will occur if and only if E does not occur. In Example 4, if event E = 
{(1, 6), (2,5), (3,4), (4,3), (5,2), (6, 1)}, then ES will occur when the sum of the dice 
does not equal 7. Note that because the experiment must result in some outcome, it 
follows that S° = @. 

For any two events E and F, if all of the outcomes in E are also in F, then we say 
that FE is contained in F, or Eis a subset of F, and write E C F (or equivalently, F D E, 
which we sometimes say as F is a superset of E). Thus, if E C F, then the occurrence 
of FE implies the occurrence of F. If E C Fand F C E, we say that FE and F are equal 
and write E = F. 

A graphical representation that is useful for illustrating logical relations among 
events is the Venn diagram. The sample space S is represented as consisting of all 
the outcomes in a large rectangle, and the events FE, F,G,... are represented as con- 
sisting of all the outcomes in given circles within the rectangle. Events of interest 
can then be indicated by shading appropriate regions of the diagram. For instance, in 
the three Venn diagrams shown in Figure 2.1, the shaded areas represent, respec- 
tively, the events E U F, EF, and E‘°. The Venn diagram in Figure 2.2 indicates 
that E C F. 


(a) Shaded region: E U F. (b) Shaded region: EF. 


S 


(c) Shaded region: E°. 


FIGURE 2.1: Venn Diagrams 
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FIGURE 2.2: E C F 


The operations of forming unions, intersections, and complements of events obey 
certain rules similar to the rules of algebra. We list a few of these rules: 


Commutative laws EUF=FUE EF =FE 
Associative laws (EUF)UG=EU(FUG) (EF)G= E(FG) 
Distributive laws (EU F)G = EGUFG EFUG=(EUG)(FUG) 


These relations are verified by showing that any outcome that is contained in the 
event on the left side of the equality sign is also contained in the event on the right 
side, and vice versa. One way of showing this is by means of Venn diagrams. For 
instance, the distributive law may be verified by the sequence of diagrams in 
Figure 2.3. 


G G 
(a) Shaded region: EG. (b) Shaded region: FG. 


E F 


G 
(c) Shaded region: (E U F)G. 


FIGURE 2.3: (EUF)G = EG U FG 
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The following useful relationships between the three basic operations of forming 
unions, intersections, and complements are known as DeMorgan’s laws: 


Cc 


n n 
Uk) =e 
i=1 i=1 

n c n 
e) =U 
i=1 i=1 


Cc 
n 
To prove DeMorgan’s laws, suppose first that x is an outcome of (6 n) . Then 
i=l 


n 
x is not contained in () £;, which means that x is not contained in any of the events 
i=l 

E;,i = 1,2,...,n, implying that x is contained in E* for alli = 1,2,...,n and thus is 
n n 

contained in a E*. To go the other way, suppose that x is an outcome of i E*. Then 
= = 

x is contained in E* for alli = 1,2,...,n, which means that x is not contained in £; for 


n 
any i = 1,2,...,n, implying that x is not contained in |) &j, in turn implying that x is 
i 


Cc 
n 
contained in (( &) . This proves the first of DeMorgan’s laws. 
1 


To prove the second of DeMorgan’s laws, we use the first law to obtain 


n qi n 
Ue) = en 
i=1 i=1 


which, since (E°)° = E, is equivalent to 


n 
Us) =n 
i 


Taking complements of both sides of the preceding equation yields the result we seek, 


namely, 
Cc 


n n 
Us=(N 
1 1 


2.3. AXIOMS OF PROBABILITY 


One way of defining the probability of an event is in terms of its relative frequency. 
Such a definition usually goes as follows: We suppose that an experiment, whose sam- 
ple space is S, is repeatedly performed under exactly the same conditions. For each 
event EF of the sample space S, we define n(£) to be the number of times in the first 1 
repetitions of the experiment that the event E occurs. Then P(E), the probability of 


the event E, is defined as 
_ ne) 
P(E) = lim —— 
n n 


—> oo 
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That is, P(E) is defined as the (limiting) proportion of time that E occurs. It is thus 
the limiting frequency of E. 

Although the preceding definition is certainly intuitively pleasing and should always 
be kept in mind by the reader, it possesses a serious drawback: How do we know that 
n(E)/n will converge to some constant limiting value that will be the same for each 
possible sequence of repetitions of the experiment? For example, suppose that the 
experiment to be repeatedly performed consists of flipping a coin. How do we know 
that the proportion of heads obtained in the first 7 flips will converge to some value 
as n gets large? Also, even if it does converge to some value, how do we know that, 
if the experiment is repeatedly performed a second time, we shall obtain the same 
limiting proportion of heads? 

Proponents of the relative frequency definition of probability usually answer this 
objection by stating that the convergence of n(£)/n to a constant limiting value is an 
assumption, or an axiom, of the system. However, to assume that n(£)/n will neces- 
sarily converge to some constant value seems to be an extraordinarily complicated 
assumption. For, although we might indeed hope that such a constant limiting fre- 
quency exists, it does not at all seem to be a priori evident that this need be the 
case. In fact, would it not be more reasonable to assume a set of simpler and more 
self-evident axioms about probability and then attempt to prove that such a con- 
stant limiting frequency does in some sense exist? The latter approach is the modern 
axiomatic approach to probability theory that we shall adopt in this text. In particular, 
we shall assume that, for each event F in the sample space S, there exists a value P(E), 
referred to as the probability of E. We shall then assume that all these probabilities 
satisfy a certain set of axioms, which, we hope the reader will agree, is in accordance 
with our intuitive notion of probability. 

Consider an experiment whose sample space is S. For each event FE of the sample 
space S, we assume that a number P(£) is defined and satisfies the following three 
axioms: 


Axiom 1 
0= P(E) =1 
Axiom 2 
P(S) =1 
Axiom 3 


For any sequence of mutually exclusive events F, E>,... (that is, events for which 
E;E; = @ when i # j), 


[oe) (oe) 
P U E;| = > P(E;) 
i=1 i=1 


We refer to P(E) as the probability of the event E. 


Thus, Axiom 1 states that the probability that the outcome of the experiment is an 
outcome in EF is some number between 0 and 1. Axiom 2 states that, with probability 
1, the outcome will be a point in the sample space S. Axiom 3 states that, for any 
sequence of mutually exclusive events, the probability of at least one of these events 
occurring is just the sum of their respective probabilities. 
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If we consider a sequence of events FE), Ey,..., where E,; = S and FE; = @ fori > 1, 
(oe) 


then, because the events are mutually exclusive and because S = (J E;, we have, from 
i=1 
Axiom 3, 


P(S) = )~ P(E;) = P(S) + 9> P@) 
i=1 i=2 


implying that 
P(@®) =0 


That is, the null event has probability 0 of occurring. 
Note that it follows that, for any finite sequence of mutually exclusive events Fj, 


a oo 
P ( | =) PE) (3.1) 
1 i=1 


This equation follows from Axiom 3 by defining F; as the null event for all values 
of i greater than n. Axiom 3 is equivalent to Equation (3.1) when the sample space 
is finite. (Why?) However, the added generality of Axiom 3 is necessary when the 
sample space consists of an infinite number of points. 


EXAMPLE 3a 


If our experiment consists of tossing a coin and if we assume that a head is as likely 
to appear as a tail, then we would have 


1 
PT = Es 


On the other hand, if the coin were biased and we felt that a head were twice as likely 
to appear as a tail, then we would have 


2 1 
POD = a) ETT) 5 | 


EXAMPLE 3b 


If a die is rolled and we suppose that all six sides are equally likely to appear, then 
we would have P({1}) = P({2}) = P({3}) = P({4}) = P{5}) = P({6}) = i. From 
Axiom 3, it would thus follow that the probability of rolling an even number would 
equal 


1 
PN, 4 01) = C2} RUE) sb ECO} = a 


The assumption of the existence of a set function P, defined on the events of a 
sample space S and satisfying Axioms 1, 2, and 3, constitutes the modern mathemat- 
ical approach to probability theory. Hopefully, the reader will agree that the axioms 
are natural and in accordance with our intuitive concept of probability as related to 
chance and randomness. Furthermore, using these axioms we shall be able to prove 
that if an experiment is repeated over and over again, then, with probability 1, the 
proportion of time during which any specific event E occurs will equal P(E). This 
result, known as the strong law of large numbers, is presented in Chapter 8. In addi- 
tion, we present another possible interpretation of probability—as being a measure 
of belief—in Section 2.7. 
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Technical Remark. We have supposed that P(£) is defined for all the events E 
of the sample space. Actually, when the sample space is an uncountably infinite set, 
P(E) is defined only for a class of events called measurable. However, this restriction 
need not concern us, as all events of any practical interest are measurable. 


2.4 SOME SIMPLE PROPOSITIONS 


In this section, we prove some simple propositions regarding probabilities. We first 
note that, since E and E* are always mutually exclusive and since E U ES = S, we 
have, by Axioms 2 and 3, 


l=fS) =P UE )=]P) + PE) 
Or, equivalently, we have Proposition 4.1. 


Proposition 4.1. 
P(E*) =1 — P(E) 


In words, Proposition 4.1 states that the probability that an event does not occur is 
1 minus the probability that it does occur. For instance, if the probability of obtaining 
a head on the toss of a coin is 3, then the probability of obtaining a tail must be 3. 

Our second proposition states that if the event & is contained in the event F, then 
the probability of F is no greater than the probability of F. 


Proposition 4.2. If E C F,then P(E) = P(F). 
Proof. Since E C F, it follows that we can express F as 
F=EU EF 
Hence, because F and E‘F are mutually exclusive, we obtain, from Axiom 3, 


P(F) = P(E) + P(E‘F) 


which proves the result, since P(E°F) = 0. 


Proposition 4.2 tells us, for instance, that the probability of rolling a 1 with a die is 
less than or equal to the probability of rolling an odd value with the die. 

The next proposition gives the relationship between the probability of the union 
of two events, expressed in terms of the individual probabilities, and the probability 
of the intersection of the events. 


Proposition 4.3. 
P(E U F) = P(E) + P(F) — P(EF) 


Proof. To derive a formula for P(E U F), we first note that E U F can be written 
as the union of the two disjoint events E and E°F. Thus, from Axiom 3, we obtain 


PEO Py =P UR UE) 
= P(E) + P(E‘F) 


Furthermore, since F = EF U E‘F, we again obtain from Axiom 3 


P(F) = P(EF) + P(E‘F) 


30 


Axioms of Probability 


by 
yy 


FIGURE 2.4: Venn Diagram 
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FIGURE 2.5: Venn Diagram in Sections 
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or, equivalently, 
P(E‘F) = P(F) — P(EF) 


thereby completing the proof. 


Proposition 4.3 could also have been proved by making use of the Venn diagram 
in Figure 2.4. 

Let us divide FE U F into three mutually exclusive sections, as shown in Figure 2.5. 
In words, section I represents all the points in E that are not in F (that is, EF‘), 
section II represents all points both in F and in F (that is, EF), and section III repre- 
sents all points in F that are not in F (that is, E°F). 

From Figure 2.5, we see that 

EUF=ITUTUIT 
E=1UII 


F=HUIU 
As I, I, and III are mutually exclusive, it follows from Axiom 3 that 
P(E U F)=P() + PdD + Pd 
P(E) = P() + Pd 
P(F) = Pd) + PdId) 


which shows that 
P(E U F)= P(E) + P(F) — PUD 


and Proposition 4.3 is proved, since II = EF. 


EXAMPLE 4a 


J is taking two books along on her holiday vacation. With probability .5, she will like 
the first book; with probability .4, she will like the second book; and with probabil- 
ity .3, she will like both books. What is the probability that she likes neither book? 
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Solution. Let B; denote the event that J likes book i,i = 1,2. Then the probability 
that she likes at least one of the books is 


P(B, U Bz) = P(B,) + P(B2) — P(BiB2)=.5 4+ 4 - 3=.6 


Because the event that J likes neither book is the complement of the event that she 
likes at least one of them, we obtain the result 


P(B{BS) = P((Bi U Bo)°) =1 — P(By U By) = 4 P| 


We may also calculate the probability that any one of the three events E, F, and G 
occurs, namely, 


PEUFUG)=P[(EU F) UG 
which, by Proposition 4.3, equals 
P(E U F) + P(G) — P[(E U F)G] 


Now, it follows from the distributive law that the events (E U F)G and EG U FG are 
equivalent; hence, from the preceding equations, we obtain 


P(E U FUG) 
= P(E) + P(F) — P(EF) + P(G) — P(EG U FG) 
= P(E) + P(F) — P(EF) + P(G) — P(EG) — P(FG) + P(EGFG) 
= P(E) + P(F) + P(G) — P(EF) — P(EG) — P(FG) + P(EFG) 


In fact, the following proposition, known as the inclusion—exclusion identity, can 
be proved by mathematical induction: 


Proposition 4.4. 


n 
P(E, U Ey UU Ey) =) P(E) — > PEyE,) + + 
i=1 iy <in 
+(-D' SO PE, Ei, + Ei,) 
ly <in<:++<i; 


+e + (1) P(E, ED --- En) 


The summation >» =P(E;, Ei, -- + E;,) is taken over all of the ( ' ) possible sub- 
ly <In<++-<i; 
sets of size r of the set {1,2,...,n}. 


In words, Proposition 4.4 states that the probability of the union of n events equals 
the sum of the probabilities of these events taken one at a time, minus the sum of the 
probabilities of these events taken two at a time, plus the sum of the probabilities of 
these events taken three at a time, and so on. 


Remarks. 1. For a noninductive argument for Proposition 4.4, note first that if an 
outcome of the sample space is not a member of any of the sets £;, then its probability 
does not contribute anything to either side of the equality. Now, suppose that an 


outcome is in exactly m of the events E;, where m > 0. Then, since it is in (J Ej, its 
i 
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probability is counted once in P { J £; }; also, as this outcome is contained in ( - ) 
i 


subsets of the type Fj, Ej, --- Ej,, its probability is counted 


times on the right of the equality sign in Proposition 4.4. Thus, for m > 0, we must 


show (at eG ona 


However, since 1 = ( a : the preceding equation is equivalent to 


m 


Yo (7) cni=o0 


i=0 
and the latter equation follows from the binomial theorem, since 


m 


O=(-14)"=>- (" ) (pia 


i=0 
2. The following is a succinct way of writing the inclusion—exclusion identity: 
n 
PULA) => CD >) PE, Fi) 
T= I<: <i, 


3. In the inclusion—exclusion identity, going out one term results in an upper bound 
on the probability of the union, going out two terms results in a lower bound on the 
probability, going out three terms results in an upper bound on the probability, going 


out four terms results in a lower bound, and so on. That is, for events Fj,..., En, 
we have 
n 
PURE) = > PE) (4.1) 
i=1 
n 
PUL,E) = > P(E) — > PGE) (4.2) 
i=1 j<i 
n 
PUL,E) = >) PED) — >> PEE) + > PUEE)EW) (4.3) 
i=1 j<i k<j<i 


and so on. To prove the validity of these bounds, note the identity 


UL, B= Ey U BEs-U BV EGEs Us U Bie BS En 
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That is, at least one of the events E; occurs if E; occurs, or if E; does not occur but 
E> does, or if EF; and E> do not occur but £3 does, and so on. Because the right-hand 
side is the union of disjoint events, we obtain 


P(Uz1 Ej) = P(E\) + PCEY En) + P(EVESE3) + ... + P(E ++: Ep_y En) 


n 
= P(E}) + )> P(Ej--- Ef 1 E)) (4.4) 
i=2 
Now, let Bj = E{ --- Ef_, = (Uj<iE;)° be the event that none of the first i — 1 events 
occur. Applying the identity 
P(Ej) = P(BiEi) + P(B; Ej) 


shows that 
P(Ej) = P(E} +: EBD + PUG Uji Ej) 


or, equivalently, 


Substituting this equation into (4.4) yields 
PUL,E) =) P(E) — >) Py EB) (4.5) 
i i 
Because probabilities are always nonnegative, Inequality (4.1) follows directly from 
Equation (4.5). Now, fixing i and applying Inequality (4.1) to P(Uj;<;E;£;) yields 
P(Uj:E)Ej) = )~ P(E:E) 
j<i 


which, by Equation (4.5). gives Inequality (4.2). Similarly, fixing and applying Inequal- 
ity (4.2) to P(U; jE; E;) yields 


PU <i Ei Ej) = >| P(E:E)) — 2 P(E} EV EVE x) 


j<i k<j<i 
=) PEE) — >> PUE:E)Ex) 
j<i k<j<i 


which, by Equation (4.5), gives Inequality (4.3). The next inclusion—exclusion inequal- 
ity is now obtained by fixing i and applying Inequality (4.3) to P(U;<;E; Ej), and 
so on. 


2.5 SAMPLE SPACES HAVING EQUALLY LIKELY OUTCOMES 


In many experiments, it is natural to assume that all outcomes in the sample space 
are equally likely to occur. That is, consider an experiment whose sample space S is a 
finite set, say, S = {1,2,...,N}. Then it is often natural to assume that 


P({1}) = P({2}) = --- = PLN) 


which implies, from Axioms 2 and 3 (why?), that 


P({i}) => f= 1,9... 0 
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From this equation, it follows from Axiom 3 that, for any event EF, 


number of outcomes in EF 


P(E) = 
©) number of outcomes in $ 
In words, if we assume that all outcomes of an experiment are equally likely to occur, 
then the probability of any event E equals the proportion of outcomes in the sample 
space that are contained in E. 


EXAMPLE 5a 


If two dice are rolled, what is the probability that the sum of the upturned faces will 
equal 7? 


Solution. We shall solve this problem under the assumption that all of the 36 possible 
outcomes are equally likely. Since there are 6 possible outcomes—namely, (1, 6), (2, 
5), (3, 4), (4, 3), (5, 2), and (6, 1)—that result in the sum of the dice being equal to 7, 
the desired probability is & = é a 


EXAMPLE 5b 


If 3 balls are “randomly drawn” from a bowl containing 6 white and 5 black balls, 
what is the probability that one of the balls is white and the other two black? 


Solution. If we regard the order in which the balls are selected as being relevant, 
then the sample space consists of 11 - 10 - 9 = 990 outcomes. Furthermore, there are 
6 - 5 - 4 = 120 outcomes in which the first ball selected is white and the other two 
are black; 5 - 6 - 4 = 120 outcomes in which the first is black, the second is white, 
and the third is black; and 5 - 4 - 6 = 120 in which the first two are black and the 
third is white. Hence, assuming that “randomly drawn” means that each outcome in 
the sample space is equally likely to occur, we see that the desired probability is 


120+ 120+ 120 4 
990 it 


This problem could also have been solved by regarding the outcome of the experi- 


3 
165 outcomes in the sample space. Now, each set of 3 balls corresponds to 3! out- 
comes when the order of selection is noted. As a result, if all outcomes are assumed 
equally likely when the order of selection is noted, then it follows that they remain 
equally likely when the outcome is taken to be the unordered set of selected balls. 
Hence, using the latter representation of the experiment, we see that the desired 


probability is 
6 5 
1 2 4 
11 ae 
3 


which, of course, agrees with the answer obtained previously. 

When the experiment consists of a random selection of k items from a set of n 
items, we have the flexibility of either letting the outcome of the experiment be the 
ordered selection of the k items or letting it be the unordered set of items selected. 
In the former case we would assume that each new selection is equally likely to be 


ment as the unordered set of drawn balls. From this point of view, there are ( . ) a 
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any of the so far unselected items of the set, and in the latter case we would assume 
that all (2) possible subsets of k items are equally likely to be the set selected. For 
instance, suppose 5 people are to be randomly selected from a group of 20 individuals 
consisting of 10 married couples, and we want to determine P(N), the probability 
that the 5 chosen are all unrelated. (That is, no two are married to each other.) If 
we regard the sample space as the set of 5 people chosen, then there are Gi equally 
likely outcomes. An outcome that does not contain a married couple can be thought 
of as being the result of a six-stage experiment: In the first stage, 5 of the 10 couples 
to have a member in the group are chosen; in the next 5 stages, 1 of the 2 members 
of each of these couples is selected. Thus, there are Cie possible outcomes in which 
the 5 members selected are unrelated, yielding the desired probability of 


In contrast, we could let the outcome of the experiment be the ordered selection 
of the 5 individuals. In this setting, there are 20 - 19 - 18 - 17 - 16 equally likely 
outcomes, of which 20 - 18 - 16 - 14 - 12 outcomes result in a group of 5 unrelated 
individuals, yielding the result 


20-18-16. 14. 12 
20-19-18-17- 16 


We leave it for the reader to verify that the two answers are identical. a 


PWN) = 


EXAMPLE 5c 


A committee of 5 is to be selected from a group of 6 men and 9 women. If the selection 
is made randomly, what is the probability that the committee consists of 3 men and 2 
women? 


Solution. Because each of the ey ) possible committees is equally likely to be selected, 
the desired probability is 


EXAMPLE 5d 


An urn contains 7 balls, one of which is special. If k of these balls are withdrawn one 
at a time, with each selection being equally likely to be any of the balls that remain at 
the time, what is the probability that the special ball is chosen? 


Solution. Since all of the balls are treated in an identical manner, it follows that the 


set of k balls selected is equally likely to be any of the ( : ) sets of k balls. Therefore, 


Hi teot) ¢ 


P{special ball is selected} = = 


i)" 
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We could also have obtained this result by letting A; denote the event that the special 
ball is the ith ball to be chosen, i = 1,...,k. Then, since each one of the n balls is 
equally likely to be the ith ball chosen, it follows that P(A;) = 1/n. Hence, because 
these events are clearly mutually exclusive, we have 


k k 
k 
P{special ball is selected} = P we = a P(Aj) = ; 
= = 


We could also have argued that P(A;) = 1/n, by noting that there are n(n — 1)---(n — 
k +1) =n!/(n — k)! equally likely outcomes of the experiment, of which (n — 1)(n — 
2)---(n-i+t1)dam—d)---a—k+1)=(H — 1)!/™ — k)! result in the special 
ball being the ith one chosen. From this reasoning, it follows that 

(n— 1)! 1 


i cole ant 


EXAMPLE 5e 


Suppose that n + m balls, of which v are red and m are blue, are arranged in a linear 
order in such a way that all (7 + m)! possible orderings are equally likely. If we 
record the result of this experiment by listing only the colors of the successive balls, 
show that all the possible results remain equally likely. 


Solution. Consider any one of the (n + m)! possible orderings, and note that any per- 
mutation of the red balls among themselves and of the blue balls among themselves 
does not change the sequence of colors. As a result, every ordering of colorings cor- 
responds to n! m! different orderings of the n + m balls, so every ordering of the 
colors has probability a of occurring. 

For example, suppose that there are 2 red balls, numbered 71,72, and 2 blue balls, 
numbered bj, b2. Then, of the 4! possible orderings, there will be 2! 2! orderings that 
result in any specified color combination. For instance, the following orderings result 
in the successive balls alternating in color, with a red ball first: 


r1,54,72,62 71,62,72,b1 ™,b1,1,b2 12,b2,m,b1 


Therefore, each of the possible orderings of the colors has probability 4 = ; of 
occurring. 


EXAMPLE 5f 


A poker hand consists of 5 cards. If the cards have distinct consecutive values and 
are not all of the same suit, we say that the hand is a straight. For instance, a hand 
consisting of the five of spades, six of spades, seven of spades, eight of spades, and 
nine of hearts is a straight. What is the probability that one is dealt a straight? 


Solution. We start by assuming that all & possible poker hands are equally 


likely. To determine the number of outcomes that are straights, let us first determine 
the number of possible outcomes for which the poker hand consists of an ace, two, 
three, four, and five (the suits being irrelevant). Since the ace can be any 1 of the 4 
possible aces, and similarly for the two, three, four, and five, it follows that there are 
4° outcomes leading to exactly one ace, two, three, four, and five. Hence, since in 4 of 
these outcomes all the cards will be of the same suit (such a hand is called a straight 
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flush), it follows that there are 4° — 4 hands that make up a straight of the form ace, 
two, three, four, and five. Similarly, there are 4° — 4 hands that make up a straight 
of the form ten, jack, queen, king, and ace. Thus, there are 10(4° — 4) hands that are 
straights, and it follows that the desired probability is 


10(4° — 4) 


52 
5 
EXAMPLE 5g 


A 5-card poker hand is said to be a full house if it consists of 3 cards of the same 
denomination and 2 other cards of the same denomination (of course, different from 
the first denomination). Thus, one kind of full house is three of a kind plus a pair. 
What is the probability that one is dealt a full house? 


= .0039 Hl 


Solution. Again, we assume that all (3) possible hands are equally likely. To 


4 
2 3 

different combinations of, say, 2 tens and 3 jacks. Because there are 13 different 
choices for the kind of pair and, after a pair has been chosen, there are 12 other 
choices for the denomination of the remaining 3 cards, it follows that the probability 


of a full house is ; j 
13-12. e ee) 
= .0014 | 


52 
5 
EXAMPLE 5h 


In the game of bridge, the entire deck of 52 cards is dealt out to 4 players. What is the 
probability that 


determine the number of possible full houses, we first note that there are 


(a) one of the players receives all 13 spades; 
(b) each player receives 1 ace? 


Solution. (a) Letting E; be the event that hand 7 has all 13 spades, then 


1 
PE)=ay, 1=1,2,3,4 
(73 
Because the events Fj, i = 1,2,3,4, are mutually exclusive, the probability that one 


of the hands is dealt all 13 spades is 


4 
52 
4 re -12 
PUL, ED = PED = 4i( a) ~ 6.3 X 10 

— 

(b) To determine the number of outcomes in which each of the distinct players 
48 

Bie 
sible divisions of the other 48 cards when each player is to receive 12. Because there 


receives exactly 1 ace, put aside the aces and note that there are 
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are 4! ways of dividing the 4 aces so that each player receives 1, we see that the num- 


; ; ; : : 48 
ber of possible outcomes in which each player receives exactly 1 ace is 4! ( 12,12, 12,12 
As there are ( ne) possible hands, the desired probability is thus 
4r(.. 48 
(12.12.1212) ~ 1055 a 


5 
(1331343) 


Some results in probability are quite surprising when initially encountered. Our 
next two examples illustrate this phenomenon. 


EXAMPLE Si 


If n people are present in a room, what is the probability that no two of them cele- 
brate their birthday on the same day of the year? How large need n be so that this 
probability is less than 5? 


Solution. As each person can celebrate his or her birthday on any one of 365 days, 
there is a total of (365)” possible outcomes. (We are ignoring the possibility of some- 
one’s having been born on February 29.) Assuming that each outcome is equally 
likely, we see that the desired probability is (365) (364) (363) ... (365 — n + 1)/(365)”. 
It is a rather surprising fact that when n = 23, this probability is less than 5 That is, if 
there are 23 or more people in a room, then the probability that at least two of them 
have the same birthday exceeds a Many people are initially surprised by this result, 
since 23 seems so small in relation to 365, the number of days of the year. However, 


every pair of individuals has probability = — of having the same birthday, 


365 
(365)? 365 
and in a group of 23 people there are (3) = 253 different pairs of individuals. 


Looked at this way, the result no longer seems so surprising. 
When there are 50 people in the room, the probability that at least two share the 
same birthday is approximately .970, and with 100 persons in the room, the odds are 


3% 10° 
better than 3,000,000:1. (That is, the probability is greater than eel el that at 
least two people have the same birthday.) 


EXAMPLE 5j 


A deck of 52 playing cards is shuffled, and the cards are turned up one at a time until 
the first ace appears. Is the next card—that is, the card following the first ace—more 
likely to be the ace of spades or the two of clubs? 


Solution. To determine the probability that the card following the first ace is the ace 
of spades, we need to calculate how many of the (52)! possible orderings of the cards 
have the ace of spades immediately following the first ace. To begin, note that each 
ordering of the 52 cards can be obtained by first ordering the 51 cards different from 
the ace of spades and then inserting the ace of spades into that ordering. Furthermore, 
for each of the (51)! orderings of the other cards, there is only one place where the 
ace of spades can be placed so that it follows the first ace. For instance, if the ordering 
of the other 51 cards is 


4c, 6h, Jd, 5s, Ac, 7d,..., Kh 


) 
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then the only insertion of the ace of spades into this ordering that results in its follow- 
ing the first ace is 
4c, 6h, Jd, 5s, Ac, As, 7d,...,Kh 


Therefore, there are (51)! orderings that result in the ace of spades following the first 
ace, sO 


(1)! 1 


P{the ace of spades follows the first ace} = Gal 32 


In fact, by exactly the same argument, it follows that the probability that the two of 
clubs (or any other specified card) follows the first ace is also a: In other words, each 
of the 52 cards of the deck is equally likely to be the one that follows the first ace! 
Many people find this result rather surprising. Indeed, a common reaction is to 
suppose initially that it is more likely that the two of clubs (rather than the ace of 
spades) follows the first ace, since that first ace might itself be the ace of spades. This 
reaction is often followed by the realization that the two of clubs might itself appear 
before the first ace, thus negating its chance of immediately following the first ace. 
However, as there is one chance in four that the ace of spades will be the first ace 
(because all 4 aces are equally likely to be first) and only one chance in five that 
the two of clubs will appear before the first ace (because each of the set of 5 cards 
consisting of the two of clubs and the 4 aces is equally likely to be the first of this set 
to appear), it again appears that the two of clubs is more likely. However, this is not 
the case, and a more complete analysis shows that they are equally likely. | 


EXAMPLE 5k 


A football team consists of 20 offensive and 20 defensive players. The players are to 
be paired in groups of 2 for the purpose of determining roommates. If the pairing is 
done at random, what is the probability that there are no offensive—defensive room- 
mate pairs? What is the probability that there are 27 offensive-defensive roommate 


pairs,i=1,2,...,10? 
40 _ (40)! 
2, 2y.00,2 J (24520 


ways of dividing the 40 players into 20 ordered pairs of two each. [That is, there 
are (40)!/27° ways of dividing the players into a first pair, a second pair, and so on.] 
Hence, there are (40)!/2?°(20)! ways of dividing the players into (unordered) pairs of 
2 each. Furthermore, since a division will result in no offensive—defensive pairs if the 
offensive (and defensive) players are paired among themselves, it follows that there 
are [(20)! Jo Oye such divisions. Hence, the probability of no offensive—defensive 
roommate pairs, call it Po, is given by 


( (20)! ) 
210(10)! [(20)!]? 


Solution. There are 


(40)! [(10)!]2(40)! 
270 (20)! 


To determine P;, the probability that there are 2i offensive—defensive pairs, we first 


note that there are >; } ways of selecting the 27 offensive players and the 2 defen- 


sive players who are to be in the offensive—defensive pairs. These 47 players can then 
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be paired up into (27)! possible offensive—defensive pairs. (This is so because the first 
offensive player can be paired with any of the 27 defensive players, the second offen- 
sive player with any of the remaining 27 — 1 defensive players, and so on.) As the 
remaining 20 — 2i offensive (and defensive) players must be paired among them- 
selves, it follows that there are 


20\7 4...) (20 — 2)! 7? 
(2:) 2! Laeao— al 


divisions which lead to 27 offensive—defensive pairs. Hence, 


2 . 2, 
20 »,| (20 — 20)! 
(i) @'| seas al 


Py (40)! i=0,1,...,10 
220(20)! 
The P ;,i = 0,1,...,10, can now be computed, or they can be approximated by mak- 


ing use of a result of Stirling which shows that n! can be approximated by n"*!/7e~",/2z. 
For instance, we obtain 


Po © 1.3403 x 10~° 
Pig & 345861 
Py) © 7.6068 X 107° = 


2 


Our next three examples illustrate the usefulness of Proposition 4.4. In Example 5], 
the introduction of probability enables us to obtain a quick solution to a counting 
problem. 
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A total of 36 members of a club play tennis, 28 play squash, and 18 play badminton. 
Furthermore, 22 of the members play both tennis and squash, 12 play both tennis and 
badminton, 9 play both squash and badminton, and 4 play all three sports. How many 
members of this club play at least one of three sports? 


Solution. Let N denote the number of members of the club, and introduce probabil- 
ity by assuming that a member of the club is randomly selected. If, for any subset C 
of members of the club, we let P(C) denote the probability that the selected member 
is contained in C, then 


number of members inC 
N 


Now, with T being the set of members that plays tennis, S being the set that plays 
squash, and B being the set that plays badminton, we have, from Proposition 4.4, 


P(C) = 


P(T US UB) 
= P(T) + P(S) + P(B) — P(TS) — P(TB) — P(SB) + P(TSB) 
6h ORG OP I 
~ N 


43 


N 


Hence, we can conclude that 43 members play at least one of the sports. | 
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The next example in this section not only possesses the virtue of giving rise to a 
somewhat surprising answer, but is also of theoretical interest. 


EXAMPLE 5m The matching problem 


Suppose that each of N men at a party throws his hat into the center of the room. 
The hats are first mixed up, and then each man randomly selects a hat. What is the 
probability that none of the men selects his own hat? 


Solution. We first calculate the complementary probability of at least one man’s 
selecting his own hat. Let us denote by Fj,i = 1,2,...,N the event that the ith man 


N 

selects his own hat. Now, by Proposition 4.4 P| J E; }, the probability that at least 
i=l 

one of the men selects his own hat is given by 


N N 

P\JEi) =>) PE) — Yo PE, E,) + ++ 
i=l i=1 iy <I2 

+" SO P(E, En: + Ei,) 

ly <IQ+*<In 


+e (14 PELE, -+- Ey) 


If we regard the outcome of this experiment as a vector of N numbers, where the ith 
element is the number of the hat drawn by the ith man, then there are N! possible 
outcomes. [The outcome (1,2,3,...,N) means, for example, that each man selects 
his own hat.] Furthermore, Ej, Ej, ... E;,,, the event that each of the n men ij, i2,..., in 
selects his own hat, can occur in any of (V — n)(N — n — 1)---3-2-1=(N—n)! 
possible ways; for, of the remaining N — n men, the first can select any of N — n 
hats, the second can then select any of N — n — 1 hats, and so on. Hence, assuming 
that all N! possible outcomes are equally likely, we see that 


(N — n)! 
P(E;, Ei, +++ Eij,) = rT 


Also, as there are ( N ) termsin >) P(E;,Ej,--- Ej,), it follows that 


ly <Ig+*<In 


NUN —n)! 1 
Dd, PBB Bin) = (N — n)in!IN! x! 


1 <Ip+**<In 


Thus, 


N 1 
| — | | N+1 
P(UE | =1 gg 
i=l 


Hence, the probability that none of the men selects his own hat is 


1 1 {—1)" 
a N! 
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which is approximately equal to e~! ~ .36788 for N large. In other words, for N large, 
the probability that none of the men selects his own hat is approximately .37. (How 
many readers would have incorrectly thought that this probability would go to 1 as 
N->co?) o 


For another illustration of the usefulness of Proposition 4.4, consider the following 
example. 


EXAMPLE 5n 


Compute the probability that 10 married couples are seated at random at a round 
table, then no wife sits next to her husband. 


Solution. If we let Ej,i = 1,2,...,10 denote the event that the ith couple sit next 


10 
to each other, it follows that the desired probability is 1 — P| LU E;}. Now, from 
i=1 


Proposition 4.4, 
10 10 
PIUE)]=> (PG ---+ Cn" Sl PE Ey: Ei) 
1 1 1 <in <*<in 


np eee ey Bp es Begg) 


To compute P(E;, F;, --- E;,,), we first note that there are 19! ways of arranging 20 
people around a round table. (Why?) The number of arrangements that result in a 
specified set of n men sitting next to their wives can most easily be obtained by first 
thinking of each of the n married couples as being single entities. If this were the case, 
then we would need to arrange 20 — n entities around a round table, and there are 
clearly (20 — n — 1)! such arrangements. Finally, since each of the m married couples 
can be arranged next to each other in one of two possible ways, it follows that there 
are 2”(20 — n — 1)! arrangements that result in a specified set of n men each sitting 
next to their wives. Therefore, 


2°(19 — n)! 
P(Ej, Fi, «= Ee) —_ ~ (9! 


Thus, from Proposition 4.4, we obtain that the probability that at least one married 
couple sits together, namely, 


10\ 4,48)! — (10) ,.07)! 10\,306)! (10 \ 19 9! 
(7) (2) aor + C3) (10 )2 cig ~ 009° 


and the desired probability is approximately .3395. | 


*EXAMPLE 5o Runs 


Consider an athletic team that had just finished its season with a final record of n 
wins and m losses. By examining the sequence of wins and losses, we are hoping to 
determine whether the team had stretches of games in which it was more likely to 
win than at other times. One way to gain some insight into this question is to count 
the number of runs of wins and then see how likely that result would be when all 
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(n + m)!/(n! m!) orderings of the n wins and m losses are assumed equally likely. By 
arun of wins, we mean a consecutive sequence of wins. For instance, ifm = 10,m = 6, 
and the sequence of outcomes was WWLLWWWLWLLLWWWYW, then there would 
be 4 runs of wins—the first run being of size 2, the second of size 3, the third of size 1, 
and the fourth of size 4. 

Suppose now that a team has n wins and m losses. Assuming that all (n + m)!/ 


n+m 


(n! m!) = ) orderings are equally likely, let us determine the probability 


that there will be exactly , runs of wins. To do so, consider first any vector of positive 
integers X1,X2,...,X- with x; + --- + x, =n, and let us see how many outcomes result 
in r runs of wins in which the ith run is of size x;,i = 1,...,7. For any such outcome, 
if we let y,; denote the number of losses before the first run of wins, y2 the number of 
losses between the first 2 runs of wins, ..., y;+, the number of losses after the last run 
of wins, then the y; satisfy 


Wot y2 tee + Vy =m yy. 2 Oy 41 2 O,y; > 0,0 =2,...,7 
and the outcome can be represented schematically as 


LL...L WW...W L...L WW...W--- WW L...L 
oC So Or eee ee or” ~— oer” 


bal x1 2 x2 Xr Yr+l 


Hence, the number of outcomes that result in r runs of wins—the ith of size x;,i = 
1,...7—is equal to the number of integers y;,...,y,41 that satisfy the foregoing, or, 
equivalently, to the number of positive integers 


y=y + 1 Ve = jt = DycsayTy Vr = Yrt +1 


that satisfy 
Wt Yoteo t+ ¥y=mt+ 2 


By Proposition 6.1 in Chapter 1, there are (” z ') such outcomes. Hence, the 


m+ 1 


total number of outcomes that result in r runs of wins is ( ), multiplied by 


the number of positive integral solutions of x, + --- + x, = n. Thus, again from 
m+1 


Proposition 6.1, there are ( ¢ 


n—-1 nee ; 
+ — 1 } outcomes resulting in r runs of wins. 


n+m 


As there are ( ) equally likely outcomes, it follows that 


m+i1 n—1 
r r=] 
m+n 
n 

- _ (7 7 
For example, if m = 8 and m = 6, then the probability of 7 runs is (3) @ ; 

14 

8 


was WLWLWLWLWWLWLW, then we might suspect that the team’s probability 
of winning was changing over time. (In particular, the probability that the team wins 


P({r runs of wins}) = r2=1 


= 1/429 if all ( . ) outcomes are equally likely. Hence, if the outcome 
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seems to be quite high when it lost its last game and quite low when it won its last 
game.) On the other extreme, if the outcome were WWWWWWWWLLLLLL, then 


there would have been only 1 run, and as P({1 run}) = ( : ) ( : ) Vi ( . ) = 1/429, 


it would thus again seem unlikely that the team’s probability of winning remained 
unchanged over its 14 games. a 


*2.6 PROBABILITY AS A CONTINUOUS SET FUNCTION 


A sequence of events {E,,,m = 1} is said to be an increasing sequence if 
po hy Cas CR SC Fag Cee 
whereas it is said to be a decreasing sequence if 
Ej 2) By 3 2 Ey 2S Ey Ss 
If {E,,n = 1} is an increasing sequence of events, then we define a new event, denoted 
by im En, by 


CO 
ae 
i=1 


Similarly, if {Ey,n = 1} is a decreasing sequence of events, we define lim E,, by 
n 


oo 
lim Ey = () E; 
i=1 


n—-co 


We now prove the following Proposition 1: 


Proposition 6.1. 
If {E,,,n = 1} is either an increasing or a decreasing sequence of events, then 


pe P(En) a ee En) 
Proof. Suppose, first, that {E,,,n = 1} is an increasing sequence, and define the 
events F,,n = 1, by 


Pye Fj 


Cc 


n—-1 
F,=£,1| J) |) =bEy #S1 
1 


where we have used the fact that J) E; = E,_1, since the events are increasing. 


1 
In words, F;, consists of those outcomes in FE, which are not in any of the earlier 
Ej,i <n. It is easy to verify that the F;, are mutually exclusive events such that 


[o-e) CO n n 
LJA=(J# and LA= UA foralln=1 
i=1 i=1 i=1 i=1 
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Thus, 


[o-e) [o-e) 
P J # =p LF 
1 iL 


> P(F;) (by Axiom 3) 
1 


n 
~ a dX PR) 
n 
= 


n 
- ee U 6] 


II 


which proves the result when {E,,,1 = 1} is increasing. 


If {En,n = 1} is a decreasing sequence, then {£*,n = 1} is an increasing sequence; 
hence, from the preceding equations, 


[ee) 
P\ Ef] = lim PE) 
1 


iG 

[o@) (oe) 

However, because |) Ef = (‘A «i , it follows that 
1 1 


Cc 
Co 


PUL) | = Pee 


or, equivalently, 
(oe) 


1-—P ( \# = lim [1 — P(En)]=1 — lim P(E) 


or 


which proves the result. 
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EXAMPLE 6a Probability and a paradox 


Suppose that we possess an infinitely large urn and an infinite collection of balls 
labeled ball number 1, number 2, number 3, and so on. Consider an experiment per- 
formed as follows: At 1 minute to 12P.M., balls numbered 1 through 10 are placed 
in the urn and ball number 10 is withdrawn. (Assume that the withdrawal takes 


no time.) At 5 minute to 12P.M., balls numbered 11 through 20 are placed in the 


urn and ball number 20 is withdrawn. At i minute to 12P.M., balls numbered 21 


through 30 are placed in the urn and ball number 30 is withdrawn. At 3 minute 
to 12P.M., and so on. The question of interest is, How many balls are in the urn at 
12P.M.? 

The answer to this question is clearly that there is an infinite number of 
balls in the urn at 12P.M., since any ball whose number is not of the form 10n, 
n = 1, will have been placed in the urn and will not have been withdrawn before 
12p.M. Hence, the problem is solved when the experiment is performed as 
described. 

However, let us now change the experiment and suppose that at 1 minute to 12 P.M. 
balls numbered 1 through 10 are placed in the urn and ball number 1 is withdrawn; at 


5 minute to 12 P.M., balls numbered 11 through 20 are placed in the urn and ball num- 


ber 2 is withdrawn; at i minute to 12P.M., balls numbered 21 through 30 are placed 
in the urn and ball number 3 is withdrawn; at , minute to 12P.M., balls numbered 31 
through 40 are placed in the urn and ball number 4 is withdrawn, and so on. For this 
new experiment, how many balls are in the urn at 12 P.M.? 

Surprisingly enough, the answer now is that the urn is empty at 12 P.M. For, consider 
any ball—say, ball number n. At some time prior to 12 P.M. [in particular, at i)" : 
minutes to 12P.M.], this ball would have been withdrawn from the urn. Hence, for 
each n, ball number z is not in the urn at 12 P.M.; therefore, the urn must be empty at 
that time. 

We see then, from the preceding discussion that the manner in which the balls are 
withdrawn makes a difference. For, in the first case only balls numbered 10n,n = 1, 
are ever withdrawn, whereas in the second case all of the balls are eventually with- 
drawn. Let us now suppose that whenever a ball is to be withdrawn, that ball is 
randomly selected from among those present. That is, suppose that at 1 minute to 
12PM. balls numbered 1 through 10 are placed in the urn and a ball is randomly 
selected and withdrawn, and so on. In this case, how many balls are in the urn at 
12P.M.? 


Solution. We shall show that, with probability 1, the urn is empty at 12 P.M. Let us 
first consider ball number 1. Define E,, to be the event that ball number 1 is still in 
the urn after the first n withdrawals have been made. Clearly, 


9-18 - 27--- (Qn) 
10 - 19 - 28---(9n + 1) 


P(En) = 


[To understand this equation, just note that if ball number 1 is still to be in the 
urn after the first n withdrawals, the first ball withdrawn can be any one of 9, the 
second any one of 18 (there are 19 balls in the urn at the time of the second with- 
drawal, one of which must be ball number 1), and so on. The denominator is similarly 
obtained. ] 
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(0.0) 
Now, the event that ball number 1 is in the urn at 12 P.M. is just the event () En. 


n= 
Because the events E,,,n = 1, are decreasing events, it follows from Proposition 6.1 that 


P{ball number 1 is in the urn at 12 P.M} 


[o-e) 
=p (En 
n=1 


= lim P(E,) 
n—>co 
_ al ( on ) 
mir On + 1 
We now show that 
= On 
IT =0 
On + 1 
n=1 
Since 
ze 
rl on \ | rl on + 1 
On + 1) — i on 
n= 


[oe) 
Hence, letting m—co and using the fact that )> 1/i = co yields 
i=1 


= 1 


Thus, letting F; denote the event that ball number 7 is in the urn at 12P.M., we have 
shown that P(F,) = 0. Similarly, we can show that P(F;) = 0 for all i. 
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(oe) 
(For instance, the same reasoning shows that P(F;) = [[[9n/(9n + 1)] fori = 
n=2 
(oe) 
11,12,...,20.) Therefore, the probability that the urn is not empty at 12P.M., P (0 F; ) 
1 


satisfies 


[oe) [o-e) 
P LF 2) Paj=0 
1 1 


by Boole’s inequality. (See Self-Test Exercise 14.) 
Thus, with probability 1, the urn will be empty at 12 P.M. a 


2.7 PROBABILITY AS A MEASURE OF BELIEF 


Thus far we have interpreted the probability of an event of a given experiment as 
being a measure of how frequently the event will occur when the experiment is con- 
tinually repeated. However, there are also other uses of the term probability. For 
instance, we have all heard such statements as “It is 90 percent probable that Shake- 
speare actually wrote Hamlet” or “The probability that Oswald acted alone in assas- 
sinating Kennedy is .8.” How are we to interpret these statements? 

The most simple and natural interpretation is that the probabilities referred to 
are measures of the individual’s degree of belief in the statements that he or she 
is making. In other words, the individual making the foregoing statements is quite 
certain that Oswald acted alone and is even more certain that Shakespeare wrote 
Hamlet. This interpretation of probability as being a measure of the degree of one’s 
belief is often referred to as the personal or subjective view of probability. 

It seems logical to suppose that a “measure of the degree of one’s belief” should 
satisfy all of the axioms of probability. For example, if we are 70 percent certain that 
Shakespeare wrote Julius Caesar and 10 percent certain that it was actually Mar- 
lowe, then it is logical to suppose that we are 80 percent certain that it was either 
Shakespeare or Marlowe. Hence, whether we interpret probability as a measure of 
belief or as a long-run frequency of occurrence, its mathematical properties remain 
unchanged. 


EXAMPLE 7a 


Suppose that, in a 7-horse race, you feel that each of the first 2 horses has a 20 percent 
chance of winning, horses 3 and 4 each have a 15 percent chance, and the remaining 
3 horses have a 10 percent chance each. Would it be better for you to wager at even 
money that the winner will be one of the first three horses or to wager, again at even 
money, that the winner will be one of the horses 1, 5, 6, and 7? 


Solution. On the basis of your personal probabilities concerning the outcome of 
the race, your probability of winning the first bet is .2 + .2 + .15 = .55, whereas 
itis 2 + 14+ 1+ .1 = .5 for the second bet. Hence, the first wager is more 
attractive. | 


Note that, in supposing that a person’s subjective probabilities are always consis- 
tent with the axioms of probability, we are dealing with an idealized rather than an 
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actual person. For instance, if we were to ask someone what he thought the chances 
were of 


(a) rain today, 

(b) rain tomorrow, 

(c) rain both today and tomorrow, 
(d) rain either today or tomorrow, 


it is quite possible that, after some deliberation, he might give 30 percent, 40 percent, 
20 percent, and 60 percent as answers. Unfortunately, such answers (or such subjec- 
tive probabilities) are not consistent with the axioms of probability. (Why not?) We 
would of course hope that, after this was pointed out to the respondent, she would 
change his answers. (One possibility we could accept is 30 percent, 40 percent, 10 
percent, and 60 percent.) 


SUMMARY 

Let S denote the set of all possible outcomes of an experiment. S is called the sample 

space of the experiment. An event is a subset of S. If Aj,i = 1,...,n, are events, then 
n 


) Aj, called the union of these events, consists of all outcomes that are in at least 
i=l 


n 
one of the events A;,i = 1,...,n. Similarly, () A;, sometimes written as A; --- Ay, is 
i=l 
called the intersection of the events A; and consists of all outcomes that are in all of 
the events A;,i=1,...,n. 

For any event A, we define A‘ to consist of all outcomes in the sample space that 
are not in A. We call A‘ the complement of the event A. The event S°, which is empty 
of outcomes, is designated by @ and is called the null set. If AB = @, then we say that 
A and B are mutually exclusive. 

For each event A of the sample space S, we suppose that a number P(A), called 
the probability of A, is defined and is such that 

Gi) OS P(A) = 1 
(i) PCS) = 1 
(iii) For mutually exclusive events A;,i = 1, 


P Jai =S P(A) 
i=1 i=1 


P(A) represents the probability that the outcome of the experiment is in A. 
It can be shown that 


P(A‘) =1 — P(A) 
A useful result is that 


P(A U B) = P(A) + P(B) — P(AB) 
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which can be generalized to give 


P\ Ai} = oP) — DOD PA) + DODD PAA) 
i=1 i=1 


i<j i<j<k 
Se pea ee (Sl PRA Ay) 
If S is finite and each one point set is assumed to have equal probability, then 


p(y = 4! 


IS| 


where |£| denotes the number of outcomes in the event E. 
P(A) can be interpreted either as a long-run relative frequency or as a measure of 


one’s degree of belief. 


PROBLEMS 


1. A box contains 3 marbles: 1 red, 1 green, and 1 


blue. Consider an experiment that consists of tak- 
ing 1 marble from the box and then replacing it 
in the box and drawing a second marble from the 
box. Describe the sample space. Repeat when the 
second marble is drawn without replacing the first 
marble. 


. In an experiment, die is rolled continually until a 


6 appears, at which point the experiment stops. 
What is the sample space of this experiment? Let 
E, denote the event that n rolls are necessary to 


complete the experiment. What points of the sam- 
Cc 


Co 
ple space are contained in E,,? What is { J E, | ? 
1 


. Two dice are thrown. Let E£ be the event that the 


sum of the dice is odd, let F be the event that 
at least one of the dice lands on 1, and let G be 
the event that the sum is 5. Describe the events 
EF,E U F,FG,EF*, and EFG. 


. A, B, and C take turns flipping a coin. The first one 


to get a head wins. The sample space of this exper- 
iment can be defined by 


— 1,01,001,0001,..., 
~ ) 0000--- 


(a) Interpret the sample space. 
(b) Define the following events in terms of S: 
(i) A wins = A. 
(ii) B wins = B. 
(iii) (A U B). 
Assume that A flips first, then B, then C, 
then A, and so on. 


. A system is comprised of 5 components, each of 


which is either working or failed. Consider an 
experiment that consists of observing the status of 


each component, and let the outcome of the exper- 

iment be given by the vector (x1,x2,%3,%4,X5), 

where x; is equal to 1 if component 7 is working 
and is equal to 0 if component / is failed. 

(a) How many outcomes are in the sample space 
of this experiment? 

(b) Suppose that the system will work if compo- 
nents 1 and 2 are both working, or if compo- 
nents 3 and 4 are both working, or if compo- 
nents 1,3, and 5 are all working. Let W be the 
event that the system will work. Specify all the 
outcomes in W. 

(c) Let A be the event that components 4 and 5 
are both failed. How many outcomes are con- 
tained in the event A? 

(d) Write out all the outcomes in the event AW. 


. A hospital administrator codes incoming patients 


suffering gunshot wounds according to whether 

they have insurance (coding 1 if they do and 0 

if they do not) and according to their condition, 

which is rated as good (g), fair (f), or serious (s). 

Consider an experiment that consists of the coding 

of such a patient. 

(a) Give the sample space of this experiment. 

(b) Let A be the event that the patient is in serious 
condition. Specify the outcomes in A. 

(c) Let B be the event that the patient is unin- 
sured. Specify the outcomes in B. 

(d) Give all the outcomes in the event BS U A. 


. Consider an experiment that consists of determin- 


ing the type of job—either blue-collar or white- 

collar—and the political affiliation—Republican, 

Democratic, or Independent—of the 15 members 

of an adult soccer team. How many outcomes are 

(a) in the sample space? 

(b) inthe event that at least one of the team mem- 
bers is a blue-collar worker? 


10. 


11. 


12. 


13. 


(c) in the event that none of the team members 
considers himself or herself an Independent? 


. Suppose that A and B are mutually exclusive 


events for which P(A) = .3 and P(B) = .5. What is 
the probability that 

(a) either A or B occurs? 

(b) A occurs but B does not? 

(c) both A and B occur? 


. Aretail establishment accepts either the American 


Express or the VISA credit card. A total of 24 per- 
cent of its customers carry an American Express 
card, 61 percent carry a VISA card, and 11 per- 
cent carry both cards. What percentage of its cus- 
tomers carry a credit card that the establishment 
will accept? 

Sixty percent of the students at a certain school 

wear neither a ring nor a necklace. Twenty per- 

cent wear a ring and 30 percent wear a necklace. 

If one of the students is chosen randomly, what is 

the probability that this student is wearing 

(a) aring or a necklace? 

(b) aring and a necklace? 

A total of 28 percent of American males smoke 

cigarettes, 7 percent smoke cigars, and 5 percent 

smoke both cigars and cigarettes. 

(a) What percentage of males smokes neither 
cigars nor cigarettes? 

(b) What percentage smokes cigars but not 
cigarettes? 

An elementary school is offering 3 language 

classes: one in Spanish, one in French, and one in 

German. The classes are open to any of the 100 

students in the school. There are 28 students in the 

Spanish class, 26 in the French class, and 16 in the 

German class. There are 12 students that are in 

both Spanish and French, 4 that are in both Span- 

ish and German, and 6 that are in both French and 

German. In addition, there are 2 students taking 

all 3 classes. 

(a) If a student is chosen randomly, what is the 
probability that he or she is not in any of the 
language classes? 

(b) If a student is chosen randomly, what is the 
probability that he or she is taking exactly one 
language class? 

(c) If2students are chosen randomly, what is the 
probability that at least 1 is taking a language 
class? 

A certain town with a population of 100,000 has 

3 newspapers: I, II, and III. The proportions of 

townspeople who read these papers are as follows: 


Tand II and 
II: 1 percent 
II: 30 percent I and III: 2 percent 

II: 5 percent II and III: 4 percent 


I: 10 percent I and II: 8 percent 


14. 


15. 


16. 


17. 
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(The list tells us, for instance, that 8000 people 

read newspapers I and II.) 

(a) Find the number of people who read only one 
newspaper. 

(b) How many people 
newspapers? 

(c) If I and III are morning papers and II is an 
evening paper, how many people read at least 
one morning paper plus an evening paper? 

(d) How many people do not read any 
newspapers? 

(e) How many people read only one morning 
paper and one evening paper? 

The following data were given in a study of a group 
of 1000 subscribers to a certain magazine: In ref- 
erence to job, marital status, and education, there 
were 312 professionals, 470 married persons, 525 
college graduates, 42 professional college gradu- 
ates, 147 married college graduates, 86 married 
professionals, and 25 married professional college 
graduates. Show that the numbers reported in the 
study must be incorrect. 

Hint: Let M, W, and G denote, respectively, the 

set of professionals, married persons, and college 

graduates. Assume that one of the 1000 persons 
is chosen at random, and use Proposition 4.4 to 
show that if the given numbers are correct, then 

PMUWUG) > 1. 


If it is assumed that all 


read at least two 


e poker hands are 


equally likely, what is the probability of being dealt 

(a) a flush? (A hand is said to be a flush if all 5 
cards are of the same suit.) 

(b) one pair? (This occurs when the cards have 
denominations a, a, b, c, d, where a, b, c, and 
d are all distinct.) 

(c) two pairs? (This occurs when the cards have 
denominations a, a, b, b, c, where a, b, and c 
are all distinct.) 

(d) three of a kind? (This occurs when the cards 
have denominations a, a, a, b, c, where a, b, 
and c are all distinct.) 

(e) four of a kind? (This occurs when the cards 
have denominations a, a, a, a, b.) 

Poker dice is played by simultaneously rolling 5 

dice. Show that 

(a) P{no two alike} = .0926; 

(b) P{one pair} = .4630; 

(c) P{two pair} = .2315; 

(d) P{three alike} = .1543; 

(e) P{full house} = .0386; 

(f) P{four alike} = .0193; 

(g) P{five alike} = .0008. 

If 8 rooks (castles) are randomly placed on a 

chessboard, compute the probability that none of 

the rooks can capture any of the others. That is, 
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compute the probability that no row or file con- 

tains more than one rook. 

Two cards are randomly selected from an ordinary 

playing deck. What is the probability that they 

form a blackjack? That is, what is the probability 
that one of the cards is an ace and the other one is 
either a ten, a jack, a queen, or a king? 

Two symmetric dice have both had two of their 

sides painted red, two painted black, one painted 

yellow, and the other painted white. When this 
pair of dice is rolled, what is the probability that 
both dice land with the same color face up? 

Suppose that you are playing blackjack against a 

dealer. In a freshly shuffled deck, what is the prob- 

ability that neither you nor the dealer is dealt a 

blackjack? 

A small community organization consists of 20 

families, of which 4 have one child, 8 have two chil- 

dren, 5 have three children, 2 have four children, 
and 1 has five children. 

(a) If one of these families is chosen at random, 
what is the probability it has i children, i = 
1,2,3,4,5? 

(b) If one of the children is randomly chosen, 
what is the probability that child comes from 
a family having i children, i = 1,2,3,4,5? 

Consider the following technique for shuffling a 

deck of cards: For any initial ordering of the 

cards, go through the deck one card at a time and 
at each card, flip a fair coin. If the coin comes 
up heads, then leave the card where it is; if the 
coin comes up tails, then move that card to the 

end of the deck. After the coin has been flipped n 

times, say that one round has been completed. For 

instance, if nm = 4 and the initial ordering is 1, 2, 3, 

4, then if the successive flips result in the outcome 

h, t, t, h, then the ordering at the end of the round 

is 1, 4,2, 3. Assuming that all possible outcomes of 

the sequence of n coin flips are equally likely, what 
is the probability that the ordering after one round 
is the same as the initial ordering? 

A pair of fair dice is rolled. What is the probabil- 

ity that the second die lands on a higher value than 

does the first? 

If two dice are rolled, what is the probability that 

the sum of the upturned faces equals i? Find it for 

i=72,3,...,11,12. 

A pair of dice is rolled until a sum of either 5 or 7 

appears. Find the probability that a 5 occurs first. 

Hint: Let E, denote the event that a 5 occurs on 

the nth roll and no 5 or 7 occurs on the first n—-1 

rolls. Compute P(E,,) and argue that 5° P(E,,) is 

n=1 

the desired probability. 

The game of craps is played as follows: A player 

rolls two dice. If the sum of the dice is either a 2, 
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3, or 12, the player loses; if the sum is either a 7 
or an 11, the player wins. If the outcome is any- 
thing else, the player continues to roll the dice until 
she rolls either the initial outcome or a 7. If the 7 
comes first, the player loses, whereas if the initial 
outcome reoccurs before the 7 appears, the player 
wins. Compute the probability of a player winning 
at craps. 

Hint: Let E; denote the event that the initial out- 
come is i ae the player wins. The desired prob- 


ability is 3 P(E;). To compute P(£j), define the 


events E;, n he be the event that the initial sum is 
i and the player wins on the nth roll. Argue that 
P(Ej) = DV P(Ein). 
n=1 

An urn contains 3 red and 7 black balls. Players A 
and B withdraw balls from the urn consecutively 
until a red ball is selected. Find the probability that 
A selects the red ball. (A draws the first ball, then 
B, and so on. There is no replacement of the balls 
drawn.) 


An urn contains 5 red, 6 blue, and 8 green balls. 
If a set of 3 balls is randomly selected, what is the 
probability that each of the balls will be (a) of the 
same color? (b) of different colors? Repeat under 
the assumption that whenever a ball is selected, its 
color is noted and it is then replaced in the urn 
before the next selection. This is known as sam- 
pling with replacement. 


An urn contains 1 white and m black balls, where 

n and m are positive numbers. 

(a) If two balls are randomly withdrawn, what is 
the probability that they are the same color? 

(b) If a ball is randomly withdrawn and then 
replaced before the second one is drawn, what 
is the probability that the withdrawn balls are 
the same color? 

(c) Show that the probability in part (b) is always 
larger than the one in part (a). 


The chess clubs of two schools consist of, respec- 

tively, 8 and 9 players. Four members from each 

club are randomly chosen to participate in a con- 

test between the two schools. The chosen play- 

ers from one team are then randomly paired with 

those from the other team, and each pairing plays 

a game of chess. Suppose that Rebecca and her sis- 

ter Elise are on the chess clubs at different schools. 

What is the probability that 

(a) Rebecca and Elise will be paired? 

(b) Rebecca and Elise will be chosen to represent 
their schools but will not play each other? 

(c) either Rebecca or Elise will be chosen to 
represent her school? 
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A 3-person basketball team consists of a guard, a 

forward, and a center. 

(a) Ifa person is chosen at random from each of 
three different such teams, what is the proba- 
bility of selecting a complete team? 

(b) What is the probability that all 3 players 
selected play the same position? 

A group of individuals containing b boys and g 

girls is lined up in random order; that is, each of 

the (b + g)! permutations is assumed to be equally 
likely. What is the probability that the person in 
the ith position, 1 =< i= b + g,isa girl? 

A forest contains 20 elk, of which 5 are captured, 

tagged, and then released. A certain time later, 4 

of the 20 elk are captured. What is the probability 

that 2 of these 4 have been tagged? What assump- 
tions are you making? 

The second Earl of Yarborough is reported to 

have bet at odds of 1000 to 1 that a bridge hand 

of 13 cards would contain at least one card that is 

ten or higher. (By ten or higher we mean that a 

card is either a ten, a jack, a queen, a king, or an 

ace.) Nowadays, we call a hand that has no cards 
higher than 9 a Yarborough. What is the proba- 

bility that a randomly selected bridge hand is a 

Yarborough? 

Seven balls are randomly withdrawn from an urn 

that contains 12 red, 16 blue, and 18 green balls. 

Find the probability that 

(a) 3 red, 2 blue, and 2 green balls are withdrawn; 

(b) at least 2 red balls are withdrawn; 

(c) all withdrawn balls are the same color; 

(d) either exactly 3 red balls or exactly 3 blue balls 
are withdrawn. 

Two cards are chosen at random from a deck of 52 

playing cards. What is the probability that they 

(a) are both aces? 

(b) have the same value? 

An instructor gives her class a set of 10 problems 

with the information that the final exam will con- 

sist of a random selection of 5 of them. If a student 
has figured out how to do 7 of the problems, what is 
the probability that he or she will answer correctly 

(a) all 5 problems? 

(b) at least 4 of the problems? 

There are 1 socks, 3 of which are red, in a drawer. 

What is the value of n if, when 2 of the socks 

are chosen randomly, the probability that they are 

both red is 5? 

There are 5 hotels in a certain town. If 3 people 

check into hotels in a day, what is the probability 

that they each check into a different hotel? What 
assumptions are you making? 

A town contains 4 people who repair televisions. 

If 4 sets break down, what is the probability that 
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exactly i of the repairers are called? Solve the 
problem for i = 1,2,3,4. What assumptions are 
you making? 

If a die is rolled 4 times, what is the probability that 
6 comes up at least once? 


Two dice are thrown n times in succession. Com- 
pute the probability that double 6 appears at least 
once. How large need n be to make this probability 
at least 5? 


(a) If N people, including A and B, are randomly 
arranged in a line, what is the probability that 
A and B are next to each other? 

(b) What would the probability be if the people 
were randomly arranged in a circle? 


Five people, designated as A, B, C, D, E, are 
arranged in linear order. Assuming that each pos- 
sible order is equally likely, what is the probabil- 
ity that 

(a) there is exactly one person between A and B? 
(b) there are exactly two people between A 

and B? 
(c) there are three people between A and B? 


A woman has n keys, of which one will open 

her door. 

(a) If she tries the keys at random, discarding 
those that do not work, what is the probability 
that she will open the door on her kth try? 

(b) What if she does not discard previously tried 
keys? 

How many people have to be in a room in order 

that the probability that at least two of them cele- 

brate their birthday in the same month is at least 

5? Assume that all possible monthly outcomes are 

equally likely. 

If there are 12 strangers in a room, what is the 

probability that no two of them celebrate their 

birthday in the same month? 


. Given 20 people, what is the probability that, 


among the 12 months in the year, there are 4 
months containing exactly 2 birthdays and 4 con- 
taining exactly 3 birthdays? 


A group of 6 men and 6 women is randomly 
divided into 2 groups of size 6 each. What is the 
probability that both groups will have the same 
number of men? 


In a hand of bridge, find the probability that you 
have 5 spades and your partner has the remain- 
ing 8. 

Suppose that n balls are randomly distributed into 
N compartments. Find the probability that m balls 
will fall into the first compartment. Assume that all 
N" arrangements are equally likely. 
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A closet contains 10 pairs of shoes. If 8 shoes 
are randomly selected, what is the probability that 
there will be 

(a) no complete pair? 

(b) exactly 1 complete pair? 

If 4 married couples are arranged in a row, find the 
probability that no husband sits next to his wife. 


Compute the probability that a bridge hand is void 
in at least one suit. Note that the answer is not 


(33) 
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(Why not?) 

Hint: Use Proposition 4.4. 

Compute the probability that a hand of 13 cards 
contains 

(a) the ace and king of at least one suit; 

(b) all 4 of at least 1 of the 13 denominations. 
Two players play the following game: Player A 
chooses one of the three spinners pictured in 
Figure 2.6, and then player B chooses one of the 
remaining two spinners. Both players then spin 
their spinner, and the one that lands on the higher 
number is declared the winner. Assuming that 
each spinner is equally likely to land in any of its 
3 regions, would you rather be player A or player 
B? Explain your answer! 


FIGURE 2.6: Spinners 


THEORETICAL EXERCISES 


Prove the following relations: 
LEFCECEUF. 


2. IfE C F,then F° C E*. 
3. F=FE U FES andEU F=E U EF. 


4. 


(0 e) Fe U E\F and 
1 1 


(A=) UF=NG U F). 
1 1 


5. For any sequence of events EF), F>,..., define a 


new sequence F), F2,... of disjoint events (that is, 
events such that F;F; = © whenever i # j) such 
that for alln = 1, 


. Let E, F, and G be three events. Find expressions 
for the events so that, of E, F, and G, 

(a) only E occurs; 

(b) both E and G, but not F, occur; 

(c) at least one of the events occurs; 

(d) at least two of the events occur; 

(e) all three events occur; 

(f) none of the events occurs; 

(g) at most one of the events occurs; 

(h) at most two of the events occur; 

(i) exactly two of the events occur; 

(j) at most three of the events occur. 

. Find the simplest expression for the following 
events: 

(a) (EU P\(E U F*); 

(b) (EU F\(ES U FYE U F*); 

(c) (EU F\(F U G). 

. Let S be a given set. If, for some k > 0, 
S;,S2,...,S% are mutually exclusive nonempty 


k 
subsets of S such that (JS; = S, then we 


i=1 

call the set {$1,5,...,S,} a partition of S. Let 
Tn denote the number of different partitions of 
{1,2,...,n}. Thus, T; = 1 (the only partition being 
S; = {1}) and 7 = 2 (the two partitions being 
{{1, 2, }}, ((1}, {2}}). 
(a) Show, by computing all partitions, that 73 = 

5,74 = 15. 
(b) Show that 


and use this equation to compute Tj. 

Hint: One way of choosing a partition of n + 1 
items is to call one of the items special. Then we 
obtain different partitions by first choosing k,k = 
0,1,...,n, then a subset of size n — k of the non- 
special items, and then any of the 7; partitions of 
the remaining k nonspecial items. By adding the 
special item to the subset of size n — k, we obtain 
a partition of allm + 1 items. 

. Suppose that an experiment is performed n times. 
For any event E of the sample space, let n(E£) 
denote the number of times that event FE occurs 
and define f(Z) = n(E)/n. Show that f(-) satisfies 
Axioms 1, 2, and 3. 
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Prove that PLE U F U G) = P(E) + P(F) + 
P(G) — PUESFG) — P(EF°G) — P(EFG‘) — 
2P(EFG). 

If P(E) = .9 and P(F) = .8, show that P(EF) = .7. 
In general, prove Bonferroni’s inequality, namely, 


P(EF) = P(E) + P(F) — 1 


. Show that the probability that exactly one of the 


events E or F occurs equals P(E) + P(F) — 
2P(EF). 


. Prove that P(EF*°) = P(E) — P(EF). 
. Prove Proposition 4.4 by mathematical induction. 
. An urn contains M white and N black balls. If a 


random sample of size r is chosen, what is the prob- 
ability that it contains exactly k white balls? 


Use induction to generalize Bonferroni’s inequal- 
ity to n events. That is, show that 


P(E, Ey-++ Ey) 2 PUE\) + ++» + PUEn) — (n — 1) 


Consider the matching problem, Example 5m, and 
define Ay to be the number of ways in which the 
N men can select their hats so that no man selects 
his own. Argue that 


Ay =(N — 1)(Ayn-1 + An-_2) 


This formula, along with the boundary conditions 
A, = 0,A2 = 1, can then be solved for Ay, and 
the desired probability of no matches would be 
An/N!. 

Hint: After the first man selects a hat that is not his 
own, there remain N — | men to select among a set 
of N — 1 hats that does not contain the hat of one 
of these men. Thus, there is one extra man and one 
extra hat. Argue that we can get no matches either 
with the extra man selecting the extra hat or with 
the extra man not selecting the extra hat. 


Let f,, denote the number of ways of tossing a coin 
n times such that successive heads never appear. 
Argue that 


fn =fn-1 + fn-2 


Hint: How many outcomes are there that start 
with a head, and how many start with a tail? If 
P,, denotes the probability that successive heads 
never appear when a coin is tossed n times, find 
P,, (in terms of f,) when all possible outcomes of 
the n tosses are assumed equally likely. Compute 
Po. 


An urn contains n red and m blue balls. They are 
withdrawn one at a time until a total of r,r = n, 


n = 2,where fo = 1, ff =2 
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red balls have been withdrawn. Find the probabil- 
ity that a total of k balls are withdrawn. 

Hint: A total of k balls will be withdrawn if there 
are r — 1 red balls in the first k — 1 withdrawals 
and the kth withdrawal is a red ball. 

Consider an experiment whose sample space con- 
sists of a countably infinite number of points. 
Show that not all points can be equally likely. 
Can all points have a positive probability of 
occurring? 

Consider Example 5o, which is concerned with the 
number of runs of wins obtained when n wins and 
m losses are randomly permuted. Now 


consider the total number of runs—that is, win 
runs plus loss runs—and show that 


( ots 1) 
k—-1 k-1 
P{2k runs} = 2 


m+n 
n 
P{2k + 1 runs} 


(BNC) +(e YG 


ee 
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SELF-TEST PROBLEMS AND EXERCISES 


. A cafeteria offers a three-course meal consisting 


of an entree, a starch, and a dessert. The possible 
choices are given in the following table: 


Course Choices 

Entree Chicken or roast beef 

Starch Pasta or rice or potatoes 

Dessert Ice cream or Jello or apple pie or a peach 


A person is to choose one course from each cate- 

gory. 

(a) How many outcomes are in the sample space? 

(b) Let A be the event that ice cream is chosen. 
How many outcomes are in A? 

(c) Let B be the event that chicken is chosen. 
How many outcomes are in B? 

(d) List all the outcomes in the event AB. 

(e) Let C be the event that rice is chosen. How 
many outcomes are in C? 

(f) List all the outcomes in the event ABC. 


. A customer visiting the suit department of a cer- 


tain store will purchase a suit with probability .22, 
a shirt with probability .30, and a tie with proba- 
bility .28. The customer will purchase both a suit 
and a shirt with probability .11, both a suit and a 
tie with probability .14, and both a shirt and a tie 
with probability .10. A customer will purchase all 3 
items with probability .06. What is the probability 
that a customer purchases 

(a) none of these items? 

(b) exactly 1 of these items? 


. A deck of cards is dealt out. What is the proba- 


bility that the 14th card dealt is an ace? What is 
the probability that the first ace occurs on the 14th 
card? 


4. Let A denote the event that the midtown temper- 


ature in Los Angeles is 70°F, and let B denote the 
event that the midtown temperature in New York 
is 70°F. Also, let C denote the event that the max- 
imum of the midtown temperatures in New York 
and in Los Angeles is 70°F. If P(A) = .3, P(B) = 
.4,and P(C) = .2, find the probability that the min- 
imum of the two midtown temperatures is 70°F. 


. An ordinary deck of 52 cards is shuffled. What is 


the probability that the top four cards have 
(a) different denominations? 
(b) different suits? 


. Urn A contains 3 red and 3 black balls, whereas 


urn B contains 4 red and 6 black balls. If a ball is 
randomly selected from each urn, what is the prob- 
ability that the balls will be the same color? 


. In a state lottery, a player must choose 8 of the 


numbers from 1 to 40. The lottery commission 
then performs an experiment that selects 8 of these 
40 numbers. Assuming that the choice of the lot- 
tery commission is equally likely to be any of the 


( i ) combinations, what is the probability that a 


player has 

(a) all 8 of the numbers selected by the lottery 
commission? 

(b) 7 of the numbers selected by the lottery com- 
mission? 

(c) at least 6 of the numbers selected by the lot- 
tery commission? 


. From a group of 3 freshmen, 4 sophomores, 4 


juniors, and 3 seniors a committee of size 4 is ran- 
domly selected. Find the probability that the com- 
mittee will consist of 

(a) 1 from each class; 

(b) 2 sophomores and 2 juniors; 

(c) only sophomores or juniors. 
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For a finite set A, let N(A) denote the number of 
elements in A. 
(a) Show that 


N(A U B) = N(A) + N(B) — N(AB) 


(b) More generally, show that 


N @ = > N(Ai) - > UN(AiA)j) 
i=l i 


i<j 


toe + (DENA: ++ An) 


Consider an experiment that consists of six horses, 
numbered 1 through 6, running a race, and sup- 
pose that the sample space consists of the 6! pos- 
sible orders in which the horses finish. Let A be 
the event that the number-1 horse is among the 
top three finishers, and let B be the event that the 
number-2 horse comes in second. How many out- 
comes are in the event A U B? 


A 5-card hand is dealt from a well-shuffled deck of 
52 playing cards. What is the probability that the 
hand contains at least one card from each of the 
four suits? 


A basketball team consists of 6 frontcourt and 
4 backcourt players. If players are divided into 
roommates at random, what is the probability that 
there will be exactly two roommate pairs made up 
of a backcourt and a frontcourt player? 


Suppose that a person chooses a letter at random 
from RES ER V E and then chooses one at ran- 
dom from VERTICAL. What is the probability 
that the same letter is chosen? 


Prove Boole’s inequality: 


P (0 Ai) < 5 PUA) 
i=1 i=1 
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Show that if P(Aj) = 
P\ (Ai 
i=1 
Let 7;(n) denote the number of partitions of the 
set {1,...,} into k nonempty subsets, where 1 = 
k = n. (See Theoretical Exercise 8 for the defini- 

tion of a partition.) Argue that 


1 for all i = 1, then 


=), 


Ty(n) =kTy(n — 1) + Tr-1(m — 1) 


Hint: In how many partitions is {1} a subset, and in 
how many is 1 an element of a subset that contains 
other elements? 

Five balls are randomly chosen, without replace- 

ment, from an urn that contains 5 red, 6 white, and 

7 blue balls. Find the probability that at least one 

ball of each color is chosen. 

Four red, 8 blue, and 5 green balls are randomly 

arranged in a line. 

(a) What is the probability that the first 5 balls are 
blue? 

(b) What is the probability that none of the first 5 
balls are blue? 

(c) What is the probability that the final 3 balls 
are differently colored. 

(d) What is the probability that all the red balls 
are together? 

Ten cards are randomly chosen from a deck of 52 

cards that consists of 13 cards of each of 4 different 

suits. Each of the selected cards is put in one of 4 

piles, depending on the suit of the card. 

(a) What is the probability that the largest pile 
has 4 cards, the next largest has 3, the next 
largest has 2, and the smallest has 1 card? 

(b) What is the probability that two of the piles 
have 3 cards, one has 4 cards, and one has no 
cards? 

Balls are randomly removed from an urn initially 

containing 20 red and 10 blue balls. What is the 

probability that all of the red balls are removed 
before all of the blue ones have been removed? 
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-5 P(-|F) IS A PROBABILITY 


INTRODUCTION 


In this chapter, we introduce one of the most important concepts in probability theory, 
that of conditional probability. The importance of this concept is twofold. In the first 
place, we are often interested in calculating probabilities when some partial informa- 
tion concerning the result of an experiment is available; in such a situation, the desired 
probabilities are conditional. Second, even when no partial information is available, 
conditional probabilities can often be used to compute the desired probabilities more 
easily. 


CONDITIONAL PROBABILITIES 


Suppose that we toss 2 dice, and suppose that each of the 36 possible outcomes is 
equally likely to occur and hence has probability x Suppose further that we observe 
that the first die is a 3. Then, given this information, what is the probability that the 
sum of the 2 dice equals 8? To calculate this probability, we reason as follows: Given 
that the initial die is a 3, there can be at most 6 possible outcomes of our experiment, 
namely, (3, 1), (3, 2), (3, 3), (3, 4), (8, 5), and (3, 6). Since each of these outcomes 
originally had the same probability of occurring, the outcomes should still have equal 
probabilities. That is, given that the first die is a 3, the (conditional) probability of 
each of the outcomes (3, 1), (3, 2), (3, 3), (3, 4), (3, 5), and (3, 6) is é> whereas the 
(conditional) probability of the other 30 points in the sample space is 0. Hence, the 
desired probability will be é. 

If we let E and F denote, respectively, the event that the sum of the dice is 8 and the 
event that the first die is a 3, then the probability just obtained is called the conditional 
probability that E occurs given that F has occurred and is denoted by 


P(E\F) 


A general formula for P(E|F) that is valid for all events FE and F is derived in the same 
manner: If the event F occurs, then, in order for E to occur, it is necessary that the 
actual occurrence be a point both in E and in F; that is, it must be in EF. Now, since 
we know that F has occurred, it follows that F becomes our new, or reduced, sample 
space; hence, the probability that the event EF occurs will equal the probability of 
EF relative to the probability of F. That is, we have the following definition. 
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Definition 


If P(F) > 0, then 
P(EF) 


PUEIF) = So 


(2.1) 


EXAMPLE 2a 


A student is taking a one-hour-time-limit makeup examination. Suppose the proba- 
bility that the student will finish the exam in less than x hours is x/2, foralO =x = 1. 
Then, given that the student is still working after .75 hour, what is the conditional 
probability that the full hour is used? 


Solution. Let L, denote the event that the student finishes the exam in less than x 
hours, 0 = x = 1, and let F be the event that the student uses the full hour. Because 
F is the event that the student is not finished in less than 1 hour, 


P(F) = P(L§) =1 — PU) = 5 


Now, the event that the student is still working at time .75 is the complement of the 
event L.75, so the desired probability is obtained from 


, P(FL“<) 
raj 
75 PUG) 
PR) 
~ 1 = P35) 
a) 


= 8 
625 = 


If each outcome of a finite sample space S is equally likely, then, conditional on 
the event that the outcome lies in a subset F C S, all outcomes in F become equally 
likely. In such cases, it is often convenient to compute conditional probabilities of 
the form P(E|F) by using F as the sample space. Indeed, working with this reduced 
sample space often results in an easier and better understood solution. Our next few 
examples illustrate this point. 


EXAMPLE 2b 


A coin is flipped twice. Assuming that all four points in the sample space S = {(h,h), 
(h, t), (t,h), (t,0)} are equally likely, what is the conditional probability that both flips 
land on heads, given that (a) the first flip lands on heads? (b) at least one flip lands 
on heads? 


Solution. Let B = {(h,h)} be the event that both flips land on heads; let F = {(h,h), 
(h, t)} be the event that the first flip lands on heads; and let A = {(h,h), (h, ft), (t,h)} be 
the event that at least one flip lands on heads. The probability for (a) can be obtained 
from 
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P(BF) 

PCF) 

_ PU (h,h)}) 
~ P({(h,h), (A.D) 
_ 1/4 


P(B\F) = 


For (b), we have 


P(BA) 

P(A) 
_ PU, A) 
~ P({(h,h), (A, 0, (,4)}) 
_ 1/4 


P(BIA) = 


Thus, the conditional probability that both flips land on heads given that the first 
one does is 1/2, whereas the conditional probability that both flips land on heads 
given that at least one does is only 1/3. Many students initially find this latter result 
surprising. They reason that, given that at least one flip lands on heads, there are 
two possible results: Either they both land on heads or only one does. Their mistake, 
however, is in assuming that these two possibilities are equally likely. For, initially, 
there are 4 equally likely outcomes. Because the information that at least one flip 
lands on heads is equivalent to the information that the outcome is not (¢,f), we are 
left with the 3 equally likely outcomes (h,h), (h, 1), (t,4), only one of which results in 
both flips landing on heads. a 


EXAMPLE 2c 


In the card game bridge, the 52 cards are dealt out equally to 4 players—called East, 
West, North, and South. If North and South have a total of 8 spades among them, 
what is the probability that East has 3 of the remaining 5 spades? 


Solution. Probably the easiest way to compute the desired probability is to work 
with the reduced sample space. That is, given that North-South have a total of 8 
spades among their 26 cards, there remains a total of 26 cards, exactly 5 of them 
being spades, to be distributed among the East-West hands. Since each distribution 
is equally likely, it follows that the conditional probability that East will have exactly 
3 spades among his or her 13 cards is 


EXAMPLE 2d 


A total of n balls are sequentially and randomly chosen, without replacement, from 
an urn containing r red and b blue balls (n = r + b). Given that k of the n balls are 
blue, what is the conditional probability that the first ball chosen is blue? 
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Solution. If we imagine that the balls are numbered, with the blue balls having num- 
bers 1 through b and the red balls b + 1 through b + ,r, then the outcome of the 
experiment of selecting n balls without replacement is a vector of distinct integers 
X1,...,Xn, where each x; is between 1 andr + b. Moreover, each such vector is equally 
likely to be the outcome. So, given that the vector contains k blue balls (that is, it 
contains k values between 1 and b), it follows that each of these outcomes is equally 
likely. But because the first ball chosen is, therefore, equally likely to be any of the 
chosen balls, of which k are blue, it follows that the desired probability is k/n. 

If we did not choose to work with the reduced sample space, we could have solved 
the problem by letting B be the event that the first ball chosen is blue and B,; be the 
event that a total of k blue balls are chosen. Then 


P(BB,) 
P(Bx) 
_ P(B;|B)P(B) 
P(Bx) 


P(B|Bx) = 


Now, P(B;|B) is the probability that a random choice of n — 1 balls from an urn 
containing r red and b — 1 blue balls results in a total of k — 1 blue balls being 
chosen; consequently, 

b-1 r 

(7-1) (14) 


P(Bx|B) = Ce) 
n—-1 
Using the preceding formula along with 
P(B) = : 
—r+b 


and the hypergeometric probability 


(1) 70) 


P(B,) = 


+b 
() 
again yields the result that 

k 

P(B|B,) = — 
Gian =— 2 

Multiplying both sides of Equation (2.1) by P(F’), we obtain 

P(EF) = P(F)P(E|F) (2.2) 


In words, Equation (2.2) states that the probability that both FE and F occur is equal 
to the probability that F occurs multiplied by the conditional probability of E given 
that F occurred. Equation (2.2) is often quite useful in computing the probability of 
the intersection of events. 


EXAMPLE 2e 
Celine is undecided as to whether to take a French course or a chemistry course. She 
estimates that her probability of receiving an A grade would be 5 in a French course 


and e in a chemistry course. If Celine decides to base her decision on the flip of a fair 
coin, what is the probability that she gets an A in chemistry? 
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Solution. (a) Let the event that Celine takes chemistry and A denote the event that 
she receives an A in whatever course she takes, then the desired probability is P(CA), 
which is calculated by using Equation (2.2) as follows: 


P(CA) = P(C)P(A|C) 
G3 
“AOINS} 3 o 


EXAMPLE 2f 

Suppose that an urn contains 8 red balls and 4 white balls. We draw 2 balls from the 
urn without replacement. (a) If we assume that at each draw each ball in the urn is 
equally likely to be chosen, what is the probability that both balls drawn are red? (b) 
Now suppose that the balls have different weights, with each red ball having weight r 
and each white ball having weight w. Suppose that the probability that a given ball in 
the urn is the next one selected is its weight divided by the sum of the weights of all 
balls currently in the urn. Now what is the probability that both balls are red? 


Solution. Let R; and R2 denote, respectively, the events that the first and second 
balls drawn are red. Now, given that the first ball selected is red, there are 7 remaining 
red balls and 4 white balls, so P(R2|R,) = i As P(R}) is clearly s, the desired 
probability is 


P(R1R2) = P(R1)P(R2|R1) 
_(2\(7\_ 14 
=(5)(r)=55 


Of course, this probability could have been computed by P(R;R2) = a fi lea? 
For part (b), we again let R; be the event that the ith ball chosen is red and use 


P(R1R2) = PCR1)P(R2|R1) 


Now, number the red balls, and let B;, i = 1,..., 8 be the event that the first ball 
drawn is red ball number 7. Then 


r 


8 
= 8 V2 ‘= 
P(R1) = PU} Bi) = ) | PB) = 8 —— 


i=1 
Moreover, given that the first ball is red, the urn then contains 7 red and 4 white balls. 
Thus, by an argument similar to the preceding one, 


7 
P(R2|R1) = ———— 
(RaIR1) Tr + 4w 
Hence, the probability that both balls are red is 


8r Tr 


P(R{R2) = 
(R12) 8r + 4w 7r + 4w = 


A generalization of Equation (2.2), which provides an expression for the probabil- 
ity of the intersection of an arbitrary number of events, is sometimes referred to as 
the multiplication rule. 
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The multiplication rule 


P(E, E2F3 +++ En) = PCE1)P(E2| £1) P(E3| £1 £2) ++» P(En|E1- ++ En-1) 


To prove the multiplication rule, just apply the definition of conditional probability 
to its right-hand side, giving 
P(E) E2) PE E2E3) PCE E2--- En) 
P(E\) P(E, £2) P(E) Eo --- En-1) 


P(E}) = P(E\E,--- En) 


EXAMPLE 2g 

In the match problem stated in Example 5m of Chapter 2, it was shown that Py, the 
probability that there are no matches when N people randomly select from among 
their own N hats, is given by 


N 
Py =) (-1)'/i! 
i=0 
What is the probability that exactly k of the N people have matches? 


Solution. Let us fix our attention on a particular set of k people and determine the 
probability that these k individuals have matches and no one else does. Letting E 
denote the event that everyone in this set has a match, and letting G be the event that 
none of the other N — k people have a match, we have 


P(EG) = P(E)P(G|E) 


Now, let Fj, i = 1,...,k, be the event that the ith member of the set has a match. 
Then 


P(E) = PUPP «+ Fx) 
= PR) PIF) P(P3|F Pa) > PULA ++ Pe—1) 


a ee 1 if 
“NN=1 N=? Ne ke 
_W-b)! 

NI 


Given that everyone in the set of k has a match, the other N — k people will be 
randomly choosing among their own N — k hats, so the probability that none of 
them has a match is equal to the probability of no matches in a problem having N — k 
people choosing among their own N — k hats. Therefore, 


N-k 
P(G\E) = Py-n = D)(-V)'/i! 
i=0 


showing that the probability that a specified set of k people have matches and no one 


else does is es 
(N — k)! 
P(EG) = aT Pn_x 
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Because there will be exactly k matches if the preceding is true for any of the Gy sets 
of k individuals, the desired probability is 


P(exactly k matches) = Py_;/k! 
~ el /k! when N is large a 


We will now employ the multiplication rule to obtain a second approach to solving 
Example 5h(b) of Chapter 2. 


EXAMPLE 2h 
An ordinary deck of 52 playing cards is randomly divided into 4 piles of 13 cards each. 
Compute the probability that each pile has exactly 1 ace. 


Solution. Define events F;,i = 1,2,3,4, as follows: 


FE, = {the ace of spades is in any one of the piles} 

E> = {the ace of spades and the ace of hearts are in different piles} 

E3 = {the aces of spades, hearts, and diamonds are all in different piles} 
E4 = {all 4 aces are in different piles} 


The desired probability is P(E, E)F3E4), and by the multiplication rule, 
P(E) Eo E3F4) = P(E}) P(E2| £1) P(E3| £1 £2) PUE4| Ey Eo E3) 


Now, 
P(E\)=1 


since E; is the sample space S. Also, 
P(EQ|F1) = = 
2a = 


since the pile containing the ace of spades will receive 12 of the remaining 51 cards, 
and 
P(23|E, E2) = - 
314142) = 50 


since the piles containing the aces of spades and hearts will receive 24 of the remain- 
ing 50 cards. Finally, 


13 
P(E4|E) Ey E3) = — 


49 

Therefore, the probability that each pile has exactly 1 ace is 
39 - 26 - 13 

P(E, £2 E3E4) = —————_ © .105 
(£1 E27 F3E4) 51.50. 49 


That is, there is approximately a 10.5 percent chance that each pile will contain an 
ace. (Problem 13 gives another way of using the multiplication rule to solve this 
problem.) | 


Remarks. Our definition of P(E|F) is consistent with the interpretation of prob- 
ability as being a long-run relative frequency. To see this, suppose that n repeti- 
tions of the experiment are to be performed, where nv is large. We claim that if 
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we consider only those experiments in which F occurs, then P(E|F) will equal the 
long-run proportion of them in which E also occurs. To verify this statement, note 
that, since P(F) is the long-run proportion of experiments in which F occurs, 
it follows that in the n repetitions of the experiment F will occur approximately 
nP(F) times. Similarly, in approximately nP(EF) of these experiments both FE and 
F will occur. Hence, out of the approximately nP(F) experiments in which 
F occurs, the proportion of them in which FE also occurs is approximately 
equal to 


nP(EF) _ P(EF) 


nP(F) P(F) 


Because this approximation becomes exact as n becomes larger and larger, we have 
the appropriate definition of P(E|F). 


3.3. BAYES’S FORMULA 
Let E and F be events. We may express E as 


E=EF U EF 
for, in order for an outcome to be in E£, it must either be in both E and F or be in 


E but not in F. (See Figure 3.1.) As EF and EF® are clearly mutually exclusive, we 
have, by Axiom 3, 


P(E) = P(EF) + P(EF‘) 
= P(E|F)P(F) + P(E|F)P(F*) (3.1) 
= P(E|F)P(F) + P(E\F)[1 — PCP] 


Equation (3.1) states that the probability of the event FE is a weighted average of the 
conditional probability of E given that F has occurred and the conditional proba- 
bility of E given that F has not occurred—each conditional probability being given 
as much weight as the event on which it is conditioned has of occurring. This is an 
extremely useful formula, because its use often enables us to determine the prob- 
ability of an event by first “conditioning” upon whether or not some second event 
has occurred. That is, there are many instances in which it is difficult to compute the 
probability of an event directly, but it is straightforward to compute it once we know 
whether or not some second event has occurred. We illustrate this idea with some 
examples. 


: 


FIGURE 3.1: E = EF U EF‘. EF = Shaded Area; EF‘ = Striped Area 
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EXAMPLE 3a (Part 1) 


An insurance company believes that people can be divided into two classes: those 
who are accident prone and those who are not. The company’s statistics show that 
an accident-prone person will have an accident at some time within a fixed 1-year 
period with probability .4, whereas this probability decreases to .2 for a person who is 
not accident prone. If we assume that 30 percent of the population is accident prone, 
what is the probability that a new policyholder will have an accident within a year of 
purchasing a policy? 


Solution. We shall obtain the desired probability by first conditioning upon whether 
or not the policyholder is accident prone. Let A; denote the event that the policy- 
holder will have an accident within a year of purchasing the policy, and let A denote 
the event that the policyholder is accident prone. Hence, the desired probability is 
given by 
P(Aj) = P(A\|A)P(A) + P(AI|AYP(A) 
= (.4)(.3) + (.2)(.7) = .26 P| 


EXAMPLE 3a (Part 2) 


Suppose that a new policyholder has an accident within a year of purchasing a policy. 
What is the probability that he or she is accident prone? 


Solution. The desired probability is 


P(AA}) 
P(A|Ay) = P(A) 
_ P(A)P(A\|A) 
P(A)) 
_ (3)(4) 6 
~~ 26 13 ca] 


EXAMPLE 3b 

Consider the following game played with an ordinary deck of 52 playing cards: The 
cards are shuffled and then turned over one at a time. At any time, the player can 
guess that the next card to be turned over will be the ace of spades; if it is, then the 
player wins. In addition, the player is said to win if the ace of spades has not yet 
appeared when only one card remains and no guess has yet been made. What is a 
good strategy? What is a bad strategy? 


Solution. Every strategy has probability 1/52 of winning! To show this, we will use 
induction to prove the stronger result that, for an n card deck, one of whose cards 
is the ace of spades, the probability of winning is 1/n, no matter what strategy is 
employed. Since this is clearly true for n = 1, assume it to be true for ann — 1 
card deck, and now consider an n card deck. Fix any strategy, and let p denote the 
probability that the strategy guesses that the first card is the ace of spades. Given that 
it does, the player’s probability of winning is 1/n. If, however, the strategy does not 
guess that the first card is the ace of spades, then the probability that the player wins 
is the probability that the first card is not the ace of spades, namely, (n — 1)/n, multi- 
plied by the conditional probability of winning given that the first card is not the ace 
of spades. But this latter conditional probability is equal to the probability of winning 
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when using ann — 1 card deck containing a single ace of spades; it is thus, by the 
induction hypothesis, 1/(n — 1). Hence, given that the strategy does not guess the 
first card, the probability of winning is 


Thus, letting G be the event that the first card is guessed, we obtain 


1 1 
P{win} = P{win|G}P(G) + Pf{win|G (1 — P(G)) = “P + 7 — p) 


EXAMPLE 3c 


In answering a question on a multiple-choice test, a student either knows the answer 
or guesses. Let p be the probability that the student knows the answer and 1 — p 
be the probability that the student guesses. Assume that a student who guesses at the 
answer will be correct with probability 1/m, where m is the number of multiple-choice 
alternatives. What is the conditional probability that a student knew the answer to a 
question given that he or she answered it correctly? 


Solution. Let C and K denote, respectively, the events that the student answers the 
question correctly and the event that he or she actually knows the answer. Now, 


P(KC) 
P(K|C) = 
(K|C) PIC) 
_ P(C\|K )P(K ) 
~ P(C|K)P(K) + P(C|K*)P(K*) 
= P 
pt (1/m)( — p) 
= ae 
1+ (m — 1)p 
For example, if m = 5,p = s then the probability that the student knew the answer 
to a question he or she answered correctly is 3. | 
EXAMPLE 3d 


A laboratory blood test is 95 percent effective in detecting a certain disease when it 
is, in fact, present. However, the test also yields a “false positive” result for 1 percent 
of the healthy persons tested. (That is, if a healthy person is tested, then, with prob- 
ability .01, the test result will imply that he or she has the disease.) If .5 percent of 
the population actually has the disease, what is the probability that a person has the 
disease given that the test result is positive? 
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Solution. Let D be the event that the person tested has the disease and E the event 
that the test result is positive. Then the desired probability is 


P(DE) 

P(E) 

_ P(E|D)P(D) 

~ P(E|D)P(D) + P(E|D)P(D*) 
_ (.95) (.005) 

~ (.95)(.005) + (.01)(.995) 


95 
= ogg 323 
Thus, only 32 percent of those persons whose test results are positive actually have 
the disease. Many students are often surprised at this result (they expect the per- 
centage to be much higher, since the blood test seems to be a good one), so it is 
probably worthwhile to present a second argument that, although less rigorous than 
the preceding one, is probably more revealing. We now do so. 

Since .5 percent of the population actually has the disease, it follows that, on the 
average, | person out of every 200 tested will have it. The test will correctly confirm 
that this person has the disease with probability .95. Thus, on the average, out of every 
200 persons tested, the test will correctly confirm that .95 person has the disease. 
On the other hand, however, out of the (on the average) 199 healthy people, the 
test will incorrectly state that (199)(.01) of these people have the disease. Hence, for 
every .95 diseased person that the test correctly states is ill, there are (on the average) 
(199)(.01) healthy persons that the test incorrectly states are ill. Thus, the proportion 
of time that the test result is correct when it states that a person is ill is 


95 _ 95 
95 + (199)(.01) 294 


P(D|E) = 


& .323 a 


Equation (3.1) is also useful when one has to reassess one’s personal probabilities 
in the light of additional information. For instance, consider the examples that follow. 


EXAMPLE 3e 


Consider a medical practitioner pondering the following dilemma: “If I’m at least 80 
percent certain that my patient has this disease, then I always recommend surgery, 
whereas if I’m not quite as certain, then I recommend additional tests that are expen- 
sive and sometimes painful. Now, initially I was only 60 percent certain that Jones 
had the disease, so I ordered the series A test, which always gives a positive result 
when the patient has the disease and almost never does when he is healthy. The test 
result was positive, and I was all set to recommend surgery when Jones informed me, 
for the first time, that he was diabetic. This information complicates matters because, 
although it doesn’t change my original 60 percent estimate of his chances of having 
the disease in question, it does affect the interpretation of the results of the A test. 
This is so because the A test, while never yielding a positive result when the patient 
is healthy, does unfortunately yield a positive result 30 percent of the time in the case 
of diabetic patients who are not suffering from the disease. Now what do I do? More 
tests or immediate surgery?” 


Solution. Yn order to decide whether or not to recommend surgery, the doctor should 
first compute her updated probability that Jones has the disease given that the A test 
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result was positive. Let D denote the event that Jones has the disease and E the event 
that the A test result is positive. The desired conditional probability is then 


P(DE) 


P(DIE) = oe 


_ P(D)P(E\|D) 

~ P(E|D)P(D) + P(E|D)P(D*) 
_ (.6)1 

~ 1(.6) + (.3)(.4) 

= .833 


Note that we have computed the probability of a positive test result by conditioning 
on whether or not Jones has the disease and then using the fact that, because Jones is 
a diabetic, his conditional probability of a positive result given that he does not have 
the disease, P(E|D°), equals .3. Hence, as the doctor should now be over 80 percent 
certain that Jones has the disease, she should recommend surgery. | 


EXAMPLE 3f 


Ata certain stage of a criminal investigation, the inspector in charge is 60 percent con- 
vinced of the guilt of a certain suspect. Suppose, however, that a new piece of evidence 
which shows that the criminal has a certain characteristic (such as left-handedness, 
baldness, or brown hair) is uncovered. If 20 percent of the population possesses this 
characteristic, how certain of the guilt of the suspect should the inspector now be if it 
turns out that the suspect has the characteristic? 


Solution. Letting G denote the event that the suspect is guilty and C the event that 
he possesses the characteristic of the criminal, we have 
P(GC) 
P(C) 


P(G|C) = 


_ P(C|G)P(G) 

~ P(C|G)P(G) + P(C|G°)P(G*) 
_ 1(.6) 

~ 16.6) + (.2)(.4) 

= 882 


where we have supposed that the probability of the suspect having the characteristic 
if he is, in fact, innocent is equal to .2, the proportion of the population possessing the 
characteristic. 


EXAMPLE 3g 


In the world bridge championships held in Buenos Aires in May 1965, the famous 
British bridge partnership of Terrence Reese and Boris Schapiro was accused of 
cheating by using a system of finger signals that could indicate the number of hearts 
held by the players. Reese and Schapiro denied the accusation, and eventually a hear- 
ing was held by the British bridge league. The hearing was in the form of a legal 
proceeding with prosecution and defense teams, both having the power to call and 
cross-examine witnesses. During the course of the proceeding, the prosecutor exam- 
ined specific hands played by Reese and Schapiro and claimed that their playing these 
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hands was consistent with the hypothesis that they were guilty of having illicit knowl- 
edge of the heart suit. At this point, the defense attorney pointed out that their play 
of these hands was also perfectly consistent with their standard line of play. How- 
ever, the prosecution then argued that, as long as their play was consistent with the 
hypothesis of guilt, it must be counted as evidence toward that hypothesis. What do 
you think of the reasoning of the prosecution? 


Solution. The problem is basically one of determining how the introduction of new 
evidence (in the preceding example, the playing of the hands) affects the probability 
of a particular hypothesis. If we let H denote a particular hypothesis (such as the 
hypothesis that Reese and Schapiro are guilty) and E the new evidence, then 


P(HE) 


P(H|E) = ae 


P(E|H)P(H) 


= (3.2) 
P(EIF)P(A) + P(EIA9[1 — PCD] 


where P(H) is our evaluation of the likelihood of the hypothesis before the intro- 
duction of the new evidence. The new evidence will be in support of the hypothesis 
whenever it makes the hypothesis more likely—that is, whenever P(H|E) = P(A). 
From Equation (3.2), this will be the case whenever 


P(E|H) = PUE\E) PU) + P(E|H [1 — PCD] 


or, equivalently, whenever 
P(E|H) = P(E\H*) 


In other words, any new evidence can be considered to be in support of a particular 
hypothesis only if its occurrence is more likely when the hypothesis is true than when 
it is false. In fact, the new probability of the hypothesis depends on its initial proba- 
bility and the ratio of these conditional probabilities, since, from Equation (3.2), 


P(H|E) = aa 


P(E|H) 


Hence, in the problem under consideration, the play of the cards can be con- 
sidered to support the hypothesis of guilt only if such play would have been more 
likely if the partnership were cheating than if they were not. As the prosecutor never 
made this claim, his assertion that the evidence is in support of the guilt hypothesis is 
invalid. 


When the author of this text drinks iced tea at a coffee shop, he asks for a glass of 
water along with the (same-sized) glass of tea. As he drinks the tea, he continuously 
refills the tea glass with water. Assuming a perfect mixing of water and tea, he won- 
dered about the probability that his final gulp would be tea. This wonderment led to 
part (a) of the following problem and to a very interesting answer. 


EXAMPLE 3h 

Urn 1 initially has n red molecules and urn 2 has n blue molecules. Molecules are 
randomly removed from urn 1 in the following manner: After each removal from 
urn 1, a molecule is taken from urn 2 (if urn 2 has any molecules) and placed in urn 1. 
The process continues until all the molecules have been removed. (Thus, there are 
2n removals in all.) 
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(a) Find P(R), where R is the event that the final molecule removed from urn 1 
is red. 

(b) Repeat the problem when urn 1 initially has 7; red molecules and b, blue 
molecules and urn 2 initially has r7 red molecules and bz blue molecules. 


Solution. (a) Focus attention on any particular red molecule, and let F be the event 
that this molecule is the final one selected. Now, in order for F to occur, the molecule 
in question must still be in the urn after the first n molecules have been removed (at 
which time urn 2 is empty). So, letting N; be the event that this molecule is not the ith 
molecule to be removed, we have 


P(F) = P(N, - +: NnF) 
= P(N) P(N2|N1) ++ PONnIN1 -- Nn—-1) PCPIM1 - Na) 


“(-DG-9) 


where the preceding formula uses the fact that the conditional probability that the 
molecule under consideration is the final molecule to be removed, given that it is still 
in urn 1 when only ” molecules remain, is, by symmetry, 1/n. 

Therefore, if we number the n red molecules and let R; be the event that red 
molecule number j is the final molecule removed, then it follows from the preceding 


formula that "4 
ray=(1-2)"! 
n} n 


Because the events Kj are mutually exclusive, we obtain 


n n 1 
PR) =P| YR} =) PR) = - =)" eet 
i=l j=l 


(b) Suppose now that urn j initially has 7; red and b; blue molecules, for i = 1,2. To 
find P(R), the probability that the final molecule removed is red, focus attention on 
any molecule that is initially in urn 1. As in part (a), it follows that the probability 
that this molecule is the final one removed is 


1 aa | 
rain) ate 
ry Oy Fy Dy 


ratb2 . o ; 
That is, (1 ae +) is the probability that the molecule under consideration 
1 


is still in urn 1 when urn 2 becomes empty, and ae is the conditional probability, 
given the preceding event, that the molecule under consideration is the final molecule 
removed. Hence, if we let O be the event that the last molecule removed is one of the 
molecules originally in urn 1, then 


1 r2+b2 
P(O) = (7, + by)p = (1 — ——— 
(O) =(" vp ( es =) 


To determine P(R), we condition on whether O occurs, to obtain 


P(R) = P(RIO)P(O) + P(RIOYP(O*) 


1 r2+b) 1 r2+b2 
ialiche glad dab tated 
ry + by ry t+ by 12 + bo ry + by 
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Ifr; + bj =12 + bz =n, s0 that both urns initially have n molecules, then, when n 
is large, 


a al + by | ois a 
The change in the probability of a hypothesis when new evidence is introduced can 
be expressed compactly in terms of the change in the odds of that hypothesis, where 
the concept of odds is defined as follows. 


Definition 
The odds of an event A are defined by 


P(A) P(A) 
P(AS) 1 — P(A) 


That is, the odds of an event A tell how much more likely it is that the event A occurs 
than it is that it does not occur. For instance, if P(A) = , then P(A) = 2P(A‘), so 
the odds are 2. If the odds are equal to a, then it is common to say that the odds are 
“a to 1” in favor of the hypothesis. 


Consider now a hypothesis H that is true with probability P(77), and suppose that 
new evidence E is introduced. Then the conditional probabilities, given the evidence 
E, that H is true and that H is not true are respectively given by 


P(E|H)P(H P(E|H°)P(H 
PUH|E) =< PEDPED —payeypy — PHP) 
P(E) P(E) 
Therefore, the new odds after the evidence E has been introduced are 
PH|E) — PCH) P(E|H) 
P(H¢|E)  P(H°) P(E|H°) 


(3.3) 


That is, the new value of the odds of H is the old value, multiplied by the ratio of the 
conditional probability of the new evidence given that H is true to the conditional 
probability given that H is not true. Thus, Equation (3.3) verifies the result of Exam- 
ple 3f, since the odds, and thus the probability of H, increase whenever the new evi- 
dence is more likely when H is true than when it is false. Similarly, the odds decrease 
whenever the new evidence is more likely when H is false than when it is true. 


EXAMPLE 3i 


An urn contains two type A coins and one type B coin. When a type A coin is flipped, 
it comes up heads with probability 1/4, whereas when a type B coin is flipped, it comes 
up heads with probability 3/4. A coin is randomly chosen from the urn and flipped. 
Given that the flip landed on heads, what is the probability that it was a type A coin? 


Solution. Let A be the event that a type A coin was flipped, and let B = A‘ be the 
event that a type B coin was flipped. We want P(A|heads), where heads is the event 
that the flip landed on heads. From Equation (3.3), we see that 
P(Al|heads) _ P(A) P(heads|A) 
P(A‘|heads) _ P(B) P(heads|B) 
_ 2/3 1/4 
~ 1/3 3/4 
= 2/3 
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Hence, the odds are 2/3 : 1, or, equivalently, the probability is 2/5 that a type A coin 
was flipped. a 


Equation (3.1) may be generalized as follows: Suppose that F), F2,..., Fy are mutu- 
ally exclusive events such that 


In other words, exactly one of the events F,, Fo,..., /, must occur. By writing 
n 
E=|JEF 
i=1 
and using the fact that the events EFj,i = 1,...,n are mutually exclusive, we obtain 


P(E) =) | P(EFi) 


i=1 


=) > P(E|F)P(Fi) (3.4) 
i=1 


Thus, Equation (3.4) shows how, for given events F), F2,...,F,, of which one and 
only one must occur, we can compute P(E) by first conditioning on which one of 
the F; occurs. That is, Equation (3.4) states that P(E) is equal to a weighted average 
of P(E|F;), each term being weighted by the probability of the event on which it is 
conditioned. 


EXAMPLE 3j 


In Example 5j of Chapter 2, we considered the probability that, for a randomly shuf- 
fled deck, the card following the first ace is some specified card, and we gave a combi- 
natorial argument to show that this probability is a: Here is a probabilistic argument 
based on conditioning: Let E be the event that the card following the first ace is some 
specified card, say, card x. To compute P(E), we ignore card x and condition on the 
relative ordering of the other 5/ cards in the deck. Letting O be the ordering gives 


P(E) = 2 P(E\O)P(O) 
oO 


Now, given O, there are 52 possible orderings of the cards, corresponding to hav- 
ing card x being the ith card in the deck, i = 1,...,52. But because all 52! possi- 
ble orderings were initially equally likely, it follows that, conditional on O, each 
of the 52 remaining possible orderings is equally likely. Because card x will follow 
the first ace for only one of these orderings, we have P(E|O) = 1/52, implying that 
P(E) = 1/52. | 


Again, let Fj,..., F, be a set of mutually exclusive and exhaustive events (meaning 
that exactly one of these events must occur). 

Suppose now that £ has occurred and we are interested in determining which one 
of the F; also occurred. Then, by Equation (3.4), we have the following proposition. 
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Proposition 3.1. 


P(EF;) 
P(E) 


_ _ PEELE) PCR) ne 


Y > PUE|Fi) PF) 


i=1 


PFE) = 


Equation (3.5) is known as Bayes’s formula, after the English philosopher Thomas 
Bayes. If we think of the events Fj as being possible “hypotheses” about some sub- 
ject matter, then Bayes’s formula may be interpreted as showing us how opinions 
about these hypotheses held before the experiment was carried out [that is, the P(F})] 
should be modified by the evidence produced by the experiment. 


EXAMPLE 3k 


A plane is missing, and it is presumed that it was equally likely to have gone down 
in any of 3 possible regions. Let 1 — 6;, i = 1, 2, 3, denote the probability that the 
plane will be found upon a search of the ith region when the plane is, in fact, in that 
region. (The constants f; are called overlook probabilities, because they represent the 
probability of overlooking the plane; they are generally attributable to the geograph- 
ical and environmental conditions of the regions.) What is the conditional probability 
that the plane is in the ith region given that a search of region 1 is unsuccessful? 


Solution. Let Rj, i = 1, 2, 3, be the event that the plane is in region i, and let E be 
the event that a search of region 1 is unsuccessful. From Bayes’s formula, we obtain 


P(ER}) 


P(E) 
P(E|R1)P(R1) 


P(Ri|E) = 


~ 3 
>. PEER) P(Ri) 
i=l 
7 (Bi) 
(B1)3 + 3 + 3 
= By 
pi + 2 


For j = 2, 3, 
P(E|R;)P(R)) 
P(E) 
_ (1)4 
(B1)3 + : - 4 
_ 1 
~ py +2 


P(R JE) = 


j=2,3 


Note that the updated (that is, the conditional) probability that the plane is in 
region j, given the information that a search of region 1 did not find it, is greater than 


Section 3.3 Bayes’s Formula 75 


the initial probability that it was in region j when j # 1 and is less than the initial prob- 
ability when j = 1. This statement is certainly intuitive, since not finding the plane in 
region 1 would seem to decrease its chance of being in that region and increase its 
chance of being elsewhere. Further, the conditional probability that the plane is in 
region 1 given an unsuccessful search of that region is an increasing function of the 
overlook probability 6;. This statement is also intuitive, since the larger { is, the 
more it is reasonable to attribute the unsuccessful search to “bad luck” as opposed 
to the plane’s not being there. Similarly, P(Rj|E),j # 1, is a decreasing function 
of By. | 


The next example has often been used by unscrupulous probability students to win 
money from their less enlightened friends. 


EXAMPLE 31 


Suppose that we have 3 cards that are identical in form, except that both sides of the 
first card are colored red, both sides of the second card are colored black, and one 
side of the third card is colored red and the other side black. The 3 cards are mixed 
up in a hat, and 1 card is randomly selected and put down on the ground. If the upper 
side of the chosen card is colored red, what is the probability that the other side is 
colored black? 


Solution. Let RR, BB, and RB denote, respectively, the events that the chosen card 
is all red, all black, or the red—black card. Also, let R be the event that the upturned 
side of the chosen card is red. Then the desired probability is obtained by 


P(RB 1 R) 
P(R|RB)P(RB) 


~ P(R|RR)P(RR) + P(R|RB)P(RB) + P(R|BB)P(BB) 
1\ (1 
_ (3) (3) 1 
(3) + GG) +08)? 
Hence, the answer is . Some students guess 5 as the answer by incorrectly reasoning 
that, given that a red side appears, there are two equally likely possibilities: that the 
card is the all-red card or the red—black card. Their mistake, however, is in assuming 
that these two possibilities are equally likely. For, if we think of each card as consist- 
ing of two distinct sides, then we see that there are 6 equally likely outcomes of the 
experiment—namely, R;, Ro, By, Bo, R3, B3—where the outcome is R, if the first side 
of the all-red card is turned face up, R2 if the second side of the all-red card is turned 
face up, R3 if the red side of the red—black card is turned face up, and so on. Since the 
other side of the upturned red side will be black only if the outcome is R3, we see that 
the desired probability is the conditional probability of R3 given that either R; or Ro 
or R3 occurred, which obviously equals 7 | 


EXAMPLE 3m 


A new couple, known to have two children, has just moved into town. Suppose that 
the mother is encountered walking with one of her children. If this child is a girl, what 
is the probability that both children are girls? 
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Solution. Let us start by defining the following events: 
Gy}: the first (that is, the oldest) child is a girl. 
G2: the second child is a girl. 

G: the child seen with the mother is a girl. 


Also, let B,, Bz, and B denote similar events, except that “girl” is replaced by “boy.” 
Now, the desired probability is P(G;G2|G), which can be expressed as follows: 


PIGGG 

P(G1G2|G) = aoe 
_ P(G1G2) 
~ P(G) 


Also, 


P(G) = P(G|G1G2)P(G1G2) + P(G|G1B2)P(G;B2) 
+ P(G|B,G2)P(B,G2) + P(G|B,B2)P(B,B2) 
= P(G,G2) + P(G|G,B2)P(G1B2) + P(G|B,G2)P(BiG2) 


where the final equation used the results P(G|G;G2) = 1 and P(G|B,B2) = 0. If we 
now make the usual assumption that all 4 gender possibilities are equally likely, then 
we see that 
1 
P(G1G2|G) = 5 : 
z+ P(G|G,B2)/4 + P(G|B,G2)/4 
1 
~ 1+ P(G|G,B2) + P(G|B,G2) 


Thus, the answer depends on whatever assumptions we want to make about the con- 
ditional probabilities that the child seen with the mother is a girl given the event Gj Bz 
and that the child seen with the mother is a girl given the event G2B}. For instance, if 
we want to assume, on the one hand, that, independently of the genders of the chil- 
dren, the child walking with the mother is the elder child with some probability p, 
then it would follow that 


P(G|G,B2) = p =1 — P(G|BiG2) 


implying under this scenario that 
1 
PG1Gz1G) = 5 


If, on the other hand, we were to assume that if the children are of different genders, 
then the mother would choose to walk with the girl with probability g, independently 
of the birth order of the children, then we would have 


P(G|G,B2) = P(G|B,G2) = q 


implying that 


iL 
P(G1G2|G) = T+ 2q 


For instance, if we took gq = 1, meaning that the mother would always choose to walk 
with a daughter, then the conditional probability the she has two daughters would be 
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7 which is in accord with Example 2b because seeing the mother with a daughter is 
now equivalent to the event that she has at least one daughter. 

Hence, as stated, the problem is incapable of solution. Indeed, even when the usual 
assumption about equally likely gender probabilities is made, we still need to make 
additional assumptions before a solution can be given. This is because the sample 
space of the experiment consists of vectors of the form s 1,57, i, where s; is the gen- 
der of the older child, sz is the gender of the younger child, and / identifies the birth 
order of the child seen with the mother. As a result, to specify the probabilities of 
the events of the sample space, it is not enough to make assumptions only about 
the genders of the children; it is also necessary to assume something about the con- 
ditional probabilities as to which child is with the mother given the genders of the 
children. a 


EXAMPLE 3n 


A bin contains 3 different types of disposable flashlights. The probability that a type 1 
flashlight will give over 100 hours of use is .7, with the corresponding probabilities for 
type 2 and type 3 flashlights being .4 and .3, respectively. Suppose that 20 percent of 
the flashlights in the bin are type 1, 30 percent are type 2, and 50 percent are type 3. 


(a) What is the probability that a randomly chosen flashlight will give more than 
100 hours of use? 


(b) Given that a flashlight lasted over 100 hours, what is the conditional probability 
that it was a type j flashlight, j = 1,2,3? 


Solution. (a) Let A denote the event that the flashlight chosen will give over 100 
hours of use, and let F; be the event that a type j flashlight is chosen, j = 1,2,3. To 
compute P(A), we condition on the type of the flashlight, to obtain 


P(A) = P(A|Fi)P(F1) + P(A|F2)P2) + P(A/F3)P(P3) 
= (.7)(.2) + (.4)(03) + (.3)(¢5) = 41 
There is a 41 percent chance that the flashlight will last for over 100 hours. 
(b) The probability is obtained by using Bayes’s formula: 
P(AF)) 
P(A) 
_ P(AIR)PR) 
7 41 


P(Fj|A) = 


Thus, 
P(F\|A) = (.7)(.2)/.41 = 14/41 
P(F2|A) = (.4)(.3)/.41 = 12/41 
P(F3|A) = (.3)(.5)/.41 = 15/41 
For instance, whereas the initial probability that a type 1 flashlight is chosen is only 


.2, the information that the flashlight has lasted over 100 hours raises the probability 
of this event to 14/41 = .341. | 


EXAMPLE 30 


A crime has been committed by a solitary individual, who left some DNA at the 
scene of the crime. Forensic scientists who studied the recovered DNA noted that 
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only five strands could be identified and that each innocent person, independently, 
would have a probability of 10~> of having his or her DNA match on all five strands. 
The district attorney supposes that the perpetrator of the crime could be any of the 
one million residents of the town. Ten thousand of these residents have been released 
from prison within the past 10 years; consequently, a sample of their DNA is on file. 
Before any checking of the DNA file, the district attorney feels that each of the ten 
thousand ex-criminals has probability a of being guilty of the new crime, while each 
of the remaining 990,000 residents has probability 6, where a = cf. (That is, the 
district attorney supposes that each recently released convict is c times as likely to 
be the crime’s perpetrator as is each town member who is not a recently released 
convict.) When the DNA that is analyzed is compared against the database of the 
ten thousand ex-convicts, it turns out that A. J. Jones is the only one whose DNA 
matches the profile. Assuming that the district attorney’s estimate of the relationship 
between a and is accurate, what is the probability that A. J. is guilty? 


Solution. To begin, note that, because probabilities must sum to 1, we have 
1 = 10,000a + 990,0008 = (10,000c + 990,000) 6 


Thus, 
_ 1 - C 
= 70,000c + 990,000? ~~ 10,000c + 990,000 


B 


Now, let G be the event that A. J. is guilty, and let M denote the event that A. J. is 
the only one of the ten thousand on file to have a match. Then 


P(GM) 


P(G|M) = aay 


_ P(G)P(MIG) 
~ P(M|G)P(G) + P(M|G*)P(G*) 


On the one hand, if A. J. is guilty, then he will be the only one to have a DNA match 
if none of the others on file have a match. Therefore, 


P(M|G) = (1 — 107°)9999 


On the other hand, if A. J. is innocent, then in order for him to be the only match, his 
DNA must match (which will occur with probability 10~>), all others in the database 
must be innocent, and none of these others can have a match. Now, given that A. J. 
is innocent, the conditional probability that all the others in the database are also 
innocent is 


Pall in database innocent) 
P(AJ innocent) 
_ 1 — 10,000a 


1l—-—a 


Pall others innocent|AJ innocent) = 


Also, the conditional probability, given their innocence, that none of the others in the 
database will have a match is (1 — 10~>)9°?. Therefore, 


1 — 10,000a 
l-—a 


P(M|G‘) = 10-> ( ) lees Ci ned ae 
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Because P(G) = a, the preceding formula gives 


a = 1 
= = ~~ 10-5 
a + 10-°(1 10,000~) = .g 4 a 


P(G|M) = 


Thus, if the district attorney’s initial feelings were that an arbitrary ex-convict was 
100 times more likely to have committed the crime than was a nonconvict (that is, 
c = 100), thena = a and 


1 
P(G|M) = —— ~*® 0.90 
aM) 1.099 oe 
If the district attorney initially felt that the appropriate ratio was c = 10, thena = 
1 


and 


109, 000 


1 
P(G|M) = —~ ® 0.5025 
eons) 1.99 
If the district attorney initially felt that the criminal was equally likely to be any of 
the members of the town (c = 1), then a = 10~° and 


1 
P(G|M) = 109 ~ 0.0917 
Thus, the probability ranges from approximately 9 percent when the district attor- 
ney’s initial assumption is that all the members of the population have the same 
chance of being the perpetrator to approximately 91 percent when she assumes that 
each ex-convict is 100 times more likely to be the criminal than is a specified townsper- 
son who is not an ex-convict. a 


3.4 INDEPENDENT EVENTS 


The previous examples of this chapter show that P(E|F), the conditional probabil- 
ity of EF given F, is not generally equal to P(E), the unconditional probability of E. 
In other words, knowing that F has occurred generally changes the chances of E’s 
occurrence. In the special cases where P(E|F) does in fact equal P(E), we say that E 
is independent of F. That is, E is independent of F if knowledge that F has occurred 
does not change the probability that FE occurs. 

Since P(E|F) = P(EF)/P(F), it follows that E is independent of F if 


P(EF) = P(E)P(F) (4.1) 


The fact that Equation (4.1) is symmetric in E and F shows that whenever F is inde- 
pendent of F, F is also independent of E. We thus have the following definition. 


Definition 


Two events E and F are said to be independent if Equation (4.1) holds. 
Two events E and F that are not independent are said to be dependent. 


EXAMPLE 4a 
A card is selected at random from an ordinary deck of 52 playing cards. If E is the 
event that the selected card is an ace and F is the event that it is a spade, then E 
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and F are independent. This follows because P(EF) = o whereas P(E) = 5 and 


P(F) = #. = 


EXAMPLE 4b 


Two coins are flipped, and all 4 outcomes are assumed to be equally likely. If E is 
the event that the first coin lands on heads and F the event that the second lands 
on tails, then FE and F are independent, since P(EF) = P({(H,T)}) = i whereas 


P(E) = P({(H, H), (H,T))) = 3 and P(F) = P((H, 71), (T, 1) = 5. 7 


EXAMPLE 4c 


Suppose that we toss 2 fair dice. Let E; denote the event that the sum of the dice is 6 
and F denote the event that the first die equals 4. Then 


1 
P(E F) = P({((4,2))) = 6 


5\/1 5 
Cl (=) (=) ~ 316 


Hence, £; and F are not independent. Intuitively, the reason for this is clear because 
if we are interested in the possibility of throwing a 6 (with 2 dice), we shall be quite 
happy if the first die lands on 4 (or, indeed, on any of the numbers 1, 2, 3, 4, and 5), 
for then we shall still have a possibility of getting a total of 6. If, however, the first 
die landed on 6, we would be unhappy because we would no longer have a chance of 
getting a total of 6. In other words, our chance of getting a total of 6 depends on the 
outcome of the first die; thus, £; and F cannot be independent. 

Now, suppose that we let Ez be the event that the sum of the dice equals 7. Is E2 
independent of F? The answer is yes, since 


whereas 


1 
P(EoF) = P({((4,3)) = 36 


P(Ey) P(F) = (=) (t) _ ( - ) 


We leave it for the reader to present the intuitive argument why the event that the 
sum of the dice equals 7 is independent of the outcome on the first die. a 


whereas 


EXAMPLE 4d 


If we let E denote the event that the next president is a Republican and F the event 
that there will be a major earthquake within the next year, then most people would 
probably be willing to assume that FE and F are independent. However, there would 
probably be some controversy over whether it is reasonable to assume that E is inde- 
pendent of G, where G is the event that there will be a recession within two years 
after the election. Oo 


We now show that if E is independent of F, then E is also independent of F°. 
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Proposition 4.1. If EF and F are independent, then so are E and F°. 


Proof. Assume that E and F are independent. Since E = EF U EF and EF and 
EF® are obviously mutually exclusive, we have 


P(E) = P(EF) + P(EF*) 
= P(E)P(F) + P(EF*) 
or, equivalently, 


P(EF*) = P(E)[1 — P(F)] 
= P(E)P(F*) 


and the result is proved. 


Thus, if EF is independent of F, then the probability of E’s occurrence is unchanged 
by information as to whether or not F has occurred. 

Suppose now that E is independent of F and is also independent of G. Is E then 
necessarily independent of FG? The answer, somewhat surprisingly, is no, as the fol- 
lowing example demonstrates. 


EXAMPLE 4e 

Two fair dice are thrown. Let E denote the event that the sum of the dice is 7. Let F 
denote the event that the first die equals 4 and G denote the event that the second 
die equals 3. From Example 4c, we know that E is independent of F’, and the same 
reasoning as applied there shows that E is also independent of G; but clearly, E is not 
independent of FG [since P(E|FG) = 1]. A 


It would appear to follow from Example 4e that an appropriate definition of the 
independence of three events E, F, and G would have to go further than merely 
assuming that all of the : ) pairs of events are independent. We are thus led to the 


following definition. 


Definition 
Three events E, F, and G are said to be independent if 
P(EFG) = P(E)P(F)P(G) 
P(EF) = P(E)P(F) 
P(EG) = P(E)P(G) 
P(FG) = P(F)P(G) 


Note that if £, F, and G are independent, then EF will be independent of any event 
formed from F and G. For instance, F is independent of F U G, since 
P[E(F U G)] = P(EF U EG) 
= P(EF) + P(EG) — P(EFG) 
= P(E)P(F) + P(E)P(G) — P(E)P(FG) 
= P(E)[P(F) + P(G) — P(FG)| 
= P(E)P(F U G) 
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Of course, we may also extend the definition of independence to more than three 
events. The events EF), F2,...,E, are said to be independent if, for every subset 
Ey, Ex,...,Ey»,r =n, of these events, 


P(Ey Ey +++ Ey) = P(Ey)P(Ey) +++ PUY) 


Finally, we define an infinite set of events to be independent if every finite subset of 
those events is independent. 

Sometimes, a probability experiment under consideration consists of performing a 
sequence of subexperiments. For instance, if the experiment consists of continually 
tossing a coin, we may think of each toss as being a subexperiment. In many cases, it 
is reasonable to assume that the outcomes of any group of the subexperiments have 
no effect on the probabilities of the outcomes of the other subexperiments. If such 
is the case, we say that the subexperiments are independent. More formally, we say 
that the subexperiments are independent if Fy, F2,..., Ey,... is necessarily an inde- 
pendent sequence of events whenever £; is an event whose occurrence is completely 
determined by the outcome of the ith subexperiment. 

If each subexperiment has the same set of possible outcomes, then the subexperi- 
ments are often called trials. 


EXAMPLE 4f 


An infinite sequence of independent trials is to be performed. Each trial results in a 
success with probability p and a failure with probability 1 — p. What is the probabil- 
ity that 

(a) at least 1 success occurs in the first n trials; 

(b) exactly k successes occur in the first n trials; 

(c) all trials result in successes? 


Solution. In order to determine the probability of at least 1 success in the first 7 trials, 
it is easiest to compute first the probability of the complementary event: that of no 
successes in the first trials. If we let E; denote the event of a failure on the /th trial, 
then the probability of no successes is, by independence, 


P(E) Ep +++ En) = P(E) P(E2)--- P(En) = (1 — py” 


Hence, the answer to part (a) is 1 — (1 — p)”. 

To compute the answer to part (b), consider any particular sequence of the first 
n outcomes containing k successes and n — k failures. Each one of these sequences 
will, by the assumed independence of trials, occur with probability p<(1 — p)"~*. 


Since there are — such sequences (there are n!/k!(n — k)! permutations of k 


successes andn — k failures), the desired probability in part (b) is 


P{exactly k successes} = ( i ) Pd =pyr 


To answer part (c), we note that, by part (a), the probability of the first 7 trials all 
resulting in success is given by 


P(ECES --- ES) =p" 
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Thus, using the continuity property of probabilities (Section 2.6), we see that the 
desired probability is given by 


[o.6) n 
c}] _ : C 
P (\E = P| lim (\E 
i=l i=1 
n 
=. c 
te 
i=1 
aioe | Uap et Py 
—ee a heme 


EXAMPLE 4g 

A system composed of n separate components is said to be a parallel system if it 
functions when at least one of the components functions. (See Figure 3.2.) For such a 
system, if component i, which is independent of the other components, functions with 
probability p;,i = 1,...,n, what is the probability that the system functions? 


Solution. Let A; denote the event that component i functions. Then 


P{system functions} = 1 — P{system does not function} 
= 1 — Pf{all components do not function} 


=1-PI()A§ 
i 


n 


=1—- [ [a — pi) by independence a 
i=l 
1 
2 
A B 
3 


n 


FIGURE 3.2: Parallel System: Functions if Current Flows from A to B 


EXAMPLE 4h 

Independent trials consisting of rolling a pair of fair dice are performed. What is the 
probability that an outcome of 5 appears before an outcome of 7 when the outcome 
of a roll is the sum of the dice? 


Solution. If we let E,, denote the event that no 5 or 7 appears on the first n — 1 trials 
and a5 appears on the nth trial, then the desired probability is 


[oe) [o-6) 
P| | JE.) =>) PG 
n=l n=1 
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Now, since P{5 on any trial} = + and P{7 on any trial} = &, we obtain, by the inde- 


pendence of trials, 
LO" A 
P(E,) = (1 ) = 


36 36 
Thus, 
sa te 7 ta 
n=1 n=1 
_ 1 1 
—~ oO 13 
94 ~ z 
_ 2 
~ 5 


This result could also have been obtained by the use of conditional probabilities. 
If we let E be the event that a 5 occurs before a 7, then we can obtain the desired 
probability, P(E), by conditioning on the outcome of the first trial, as follows: Let F 
be the event that the first trial results in a5, let G be the event that it results in a 7, and 
let H be the event that the first trial results in neither a 5 nor a 7. Then, conditioning 
on which one of these events occurs gives 


P(E) = P(E|F)P(F) + P(E|G)P(G) + PCE|H) PA) 


However, 
P(E|F) =1 
P(E|G) =0 
P(E|H) = P(E) 


The first two equalities are obvious. The third follows because if the first outcome 
results in neither a 5 nor a 7, then at that point the situation is exactly as it was when 
the problem first started—namely, the experimenter will continually roll a pair of fair 
dice until either a 5 or 7 appears. Furthermore, the trials are independent; therefore, 
the outcome of the first trial will have no effect on subsequent rolls of the dice. Since 
P(F) = > P(G) = es and P(H) = it follows that 


1 13 
P(E) = sr P(E) 73 


or 
P(E) = : 
“a 
The reader should note that the answer is quite intuitive. That is, because a 5 occurs 
on any roll with probability and a 7 with probability 2, it seems intuitive that the 
odds that a 5 appears before a 7 should be 6 to 4 against. The probability should then 
be am as indeed it is. 
The same argument shows that if EF and F are mutually exclusive events of an 
experiment, then, when independent trials of the experiment are performed, the 
event E will occur before the event F with probability 


P(E) 


PE) + PP) 7 
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EXAMPLE 4i 

There are n types of coupons, and each new one collected is independently of type 7 
with probability p;, )~_; pi = 1. Suppose k coupons are to be collected. If A; is the 
event that there is at least one type i coupon among those collected, then, for i # j, 
find 


(a) P(Aj) 
(b) P(A; U Aj) 
(c) P(Aj|Aj) 
Solution. 
P(Aj) =1 — P(AS) 
= 1 — P{no coupon is type 7} 
=1- (1 - pi* 
where the preceding used that each coupon is, independently, not of type i with prob- 
ability 1 — p;. Similarly, 
P(Aj U Aj) =1 — P((A; U Aj)*) 
= 1 — P{no coupon is either type i or type j} 
=1-(-p - p)* 


where the preceding used that each coupon is, independently, neither of type i nor 
type j with probability 1 — p; — pj. 
To determine P(Aj;|Aj;), we will use the identity 


P(A; U Aj) = P(Aj) + P(Aj) — P(AiA)) 
which, in conjunction with parts (a) and (b), yields 
PAA) =1- 1 - p)* +1-C-p)*- 1-0 - pi - pp] 
=1-d-pi)*-G—p)* +a —pi — pi 


Consequently, 


PrAjaya P44? 1 = 0 = pi — 0 — pi + = pi pp! 
P(A) 1— d — pk = 


The next example presents a problem that occupies an honored place in the his- 
tory of probability theory. This is the famous problem of the points. In general terms, 
the problem is this: Two players put up stakes and play some game, with the stakes 
to go to the winner of the game. An interruption requires them to stop before either 
has won and when each has some sort of a “partial score.” How should the stakes be 
divided? 

This problem was posed to the French mathematician Blaise Pascal in 1654 by 
the Chevalier de Méré, who was a professional gambler at that time. In attacking 
the problem, Pascal introduced the important idea that the proportion of the prize 
deserved by the competitors should depend on their respective probabilities of win- 
ning if the game were to be continued at that point. Pascal worked out some special 
cases and, more importantly, initiated a correspondence with the famous French- 
man Pierre de Fermat, who had a great reputation as a mathematician. The resulting 
exchange of letters not only led to a complete solution to the problem of the points, 
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but also laid the framework for the solution to many other problems connected with 
games of chance. This celebrated correspondence, dated by some as the birth date 
of probability theory, was also important in stimulating interest in probability among 
the mathematicians in Europe, for Pascal and Fermat were both recognized as being 
among the foremost mathematicians of the time. For instance, within a short time of 
their correspondence, the young Dutch mathematician Christiaan Huygens came to 
Paris to discuss these problems and solutions, and interest and activity in this new 
field grew rapidly. 


EXAMPLE 4j The problem of the points 


Independent trials resulting in a success with probability p and a failure with proba- 
bility 1 — p are performed. What is the probability that m successes occur before m 
failures? If we think of A and B as playing a game such that A gains 1 point when a 
success occurs and B gains 1 point when a failure occurs, then the desired probability 
is the probability that A would win if the game were to be continued in a position 
where A needed 1 and B needed m more points to win. 


Solution. We shall present two solutions. The first is due to Pascal and the second to 
Fermat. 

Let us denote by P,, the probability that 1 successes occur before m failures. By 
conditioning on the outcome of the first trial, we obtain 


Prim = pPn—1m hs P)Pnm-1 n2i,m=2 1 


(Why? Reason it out.) Using the obvious boundary conditions P;,9 = 0, Po,m = 1, we 
can solve these equations for Pym. Rather than go through the tedious details, let us 
instead consider Fermat’s solution. 

Fermat argued that, in order for n successes to occur before m failures, it is nec- 
essary and sufficient that there be at least n successes in the first m + n — 1 trials. 
(Even if the game were to end before a total of m + n — 1 trials were completed, we 
could still imagine that the necessary additional trials were performed.) This is true, 
for if there are at least n successes in the first m + n — 1 trials, there could be at 
most m — 1 failures in those m + n — 1 trials; thus, m successes would occur before 
m failures. If, however, there were fewer than n successes in the first m + n — 1 
trials, there would have to be at least m failures in that same number of trials; thus, 1 
successes would not occur before m failures. 

Hence, since, as shown in Example 4f, the probability of exactly k successes in 
m+n — I trials is ue =e = pk — pynte-lk it follows that the desired 


probability of n successes before m failures is 


m+n—-1 cor 
Phim = > ( k )eka = poe 
k=n 


Our next two examples deal with gambling problems, with the first having a sur- 
prisingly elegant analysis.* 


EXAMPLE 4k 
Suppose that initially there are r players, with player i having n; units, n; > 0,7 = 
1,...,7. At each stage, two of the players are chosen to play a game, with the winner 


*The remainder of this section should be considered optional. 
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of the game receiving 1 unit from the loser. Any player whose fortune drops to 0 is 
eliminated, and this continues until a single player has all n = )°;_, nj; units, with 
that player designated as the victor. Assuming that the results of successive games 
are independent and that each game is equally likely to be won by either of its two 
players, find P;, the probability that player i is the victor? 


Solution. To begin, suppose that there are v players, with each player initially having 
1 unit. Consider player i. Each stage she plays will be equally likely to result in her 
either winning or losing 1 unit, with the results from each stage being independent. 
In addition, she will continue to play stages until her fortune becomes either 0 or n. 
Because this is the same for all n players, it follows that each player has the same 
chance of being the victor, implying that each player has probability 1/n of being the 
victor. Now, suppose these n players are divided into r teams, with team i containing 
n; players, i = 1,...,r. Then the probability that the victor is a member of team 7 is 
nj/n. But because 


(a) team / initially has a total fortune of n; units,i = 1,...,r, and 

(b) each game played by members of different teams is equally likely to be won by 
either player and results in the fortune of members of the winning team increas- 
ing by 1 and the fortune of the members of the losing team decreasing by J, 


it is easy to see that the probability that the victor is from team i is exactly the prob- 
ability we desire. Thus, P; = n;/n. Interestingly, our argument shows that this result 
does not depend on how the players in each stage are chosen. @ 


In the gambler’s ruin problem, there are only 2 gamblers, but they are not assumed 
to be of equal skill. 


EXAMPLE 41 The gambler’s ruin problem 


Two gamblers, A and B, bet on the outcomes of successive flips of a coin. On each 
flip, if the coin comes up heads, A collects 1 unit from B, whereas if it comes up tails, 
A pays 1 unit to B. They continue to do this until one of them runs out of money. If 
it is assumed that the successive flips of the coin are independent and each flip results 
in a head with probability p, what is the probability that A ends up with all the money 
if he starts with 7 units and B starts with N — i units? 


Solution. Let E denote the event that A ends up with all the money when he starts 
with i and B starts with N — i, and to make clear the dependence on the initial fortune 
of A, let P; = P(E). We shall obtain an expression for P(E) by conditioning on the 
outcome of the first flip as follows: Let H denote the event that the first flip lands on 
heads; then 


P; = P(E) = P(E|A)P(A) + P(E|A) P(A) 
= pP(E|H) + (1 — p)P(E\|H*) 


Now, given that the first flip lands on heads, the situation after the first bet is that 
A hasi + 1 units and B has N — (i + 1). Since the successive flips are assumed to 
be independent with a common probability p of heads, it follows that, from that point 
on, A’s probability of winning all the money is exactly the same as if the game were 
just starting with A having an initial fortune of i + 1 and B having an initial fortune 
of N — (i + 1). Therefore, 


P(E\|A) = Pit 
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and similarly, 
P(E|H®) = Pi- 


Hence, letting g = 1 — p, we obtain 


P)=pPi41 + gPi-1  i=1,2,...,N—1 


(4.2) 


By making use of the obvious boundary conditions Py = 0 and Py = 1, we shall 


now solve Equation (4.2). Since p + g = 1, these equations are equivalent to 


PP; + qPi =pPis1 + QPi-1 


or 
Piz, — Pi= cd = Fi) 


Hence, since Pp = 0, we obtain, from Equation (4.3), 


i-1 
P; — Pia = 2(Pi4 — Pir) = (2) Pi 
P P 


N-1 
Py — Py-i1= AP — Py-2) = (2) Pi 
P P 


Adding the first i — 1 equations of (4.4) yields 


nner’) (++) 


or 
— i 
(q/P) , ated 
p,=}) 1- G/p) P 
iP; if 4 <1 
p 


Using the fact that Py = 1, we obtain 


(q/P) , 1 
cam 2 fo zt 
P, =} 1- G@/p)* ad 


ae 
N 


(4.3) 


(4.4) 
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Hence, 
1— i 
Cu ifp # } 
Pi=t 1 = @/p) (4.5) 
N ifp = 5 


Let Q; denote the probability that B winds up with all the money when A starts 
with i and B starts with N — i. Then, by symmetry to the situation described, and on 
replacing p by g andiby N — i, it follows that 


1-(p/gh 1 
T-@/gN "1*2 

Qj = ; 
ee ifq=} 
N 2 


Moreover, since g = 5 is equivalent to p = i we have, when g # 7 


1—(@/p  1-@/@r= 
Pi + Q= 
Q 1 — (q/p)X 1 — (p/q)% 


_ PN — pNaipy | aN - Boia 


~ pN = qn qn _ pN 
_ pN = pN-igi _ q’ i gipN-i 
pN _ qn 


=1 
This result also holds when p = gq = 7 so 
Pi + Qi=1 


In words, this equation states that, with probability 1, either A or B will wind up 
with all of the money; in other words, the probability that the game continues indefi- 
nitely with A’s fortune always being between 1 and N — 1 is zero. (The reader must 
be careful because, a priori, there are three possible outcomes of this gambling game, 
not two: Either A wins, or B wins, or the game goes on forever with nobody winning. 
We have just shown that this last event has probability 0.) 

As a numerical illustration of the preceding result, if A were to start with 5 units 
and B with 10, then the probability of A’s winning would be 5 if p were 7. whereas it 


would jump to ; 
BD) ae 


if p were .6. 

A special case of the gambler’s ruin problem, which is also known as the problem of 
duration of play, was proposed to Huygens by Fermat in 1657. The version Huygens 
proposed, which he himself solved, was that A and B have 12 coins each. They play 
for these coins in a game with 3 dice as follows: Whenever 11 is thrown (by either—it 
makes no difference who rolls the dice), A gives a coin to B. Whenever 14 is thrown, 
B gives a coin to A. The person who first wins all the coins wins the game. Since 
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P{roll 11} = ak and P{roll 14} = a we see from Example 4h that, for A, this is 


just the gambler’s ruin problem with p = Bi = 12, and N = 24. The general form 
of the gambler’s ruin problem was solved by the mathematician James Bernoulli and 
published 8 years after his death in 1713. 

For an application of the gambler’s ruin problem to drug testing, suppose that two 
new drugs have been developed for treating a certain disease. Drug i has a cure rate 
P;,i = 1,2, in the sense that each patient treated with drug i will be cured with proba- 
bility P;. These cure rates are, however, not known, and we are interested in finding a 
method for deciding whether P; > P or P2 > P,. To decide on one of these alterna- 
tives, consider the following test: Pairs of patients are to be treated sequentially, with 
one member of the pair receiving drug 1 and the other drug 2. The results for each 
pair are determined, and the testing stops when the cumulative number of cures from 
one of the drugs exceeds the cumulative number of cures from the other by some 
fixed, predetermined number. More formally, let 


Y= 1 if the patient in the jth pair that receives drug 1 is cured 
1“ |) 0 otherwise 


Y= 1 if the patient in the jth pair that receives drug 2 is cured 
!~~ ) 0 otherwise 


For a predetermined positive integer M, the test stops after pair N, where N is the 
first value of n such that either 


or 


Xi + +++ + Xn (Y; + +++ + Yn) = —-M 


In the former case, we assert that P; > P> and in the latter that Py > Py. 

In order to help ascertain whether the foregoing is a good test, one thing we would 
like to know is the probability that it leads to an incorrect decision. That is, for given 
P, and P2, where P; > P 2, what is the probability that the test will incorrectly assert 
that P2 > P,? To determine this probability, note that after each pair is checked, 
the cumulative difference of cures using drug 1 versus drug 2 will go up by 1 with 
probability P;(1 — P 2)—since this is the probability that drug 1 leads to a cure and 
drug 2 does not—or go down by 1 with probability (1 — P ,)P2, or remain the same 
with probability P;P2 + (1 — P,)(1 — P2). Hence, if we consider only those pairs 
in which the cumulative difference changes, then the difference will go up by 1 with 
probability 


P = P{up 1|up 1 or down 1} 
= eth = 29) 
Pi = Pa) Pao 


and down by 1 with probability 


Poth Pi) 


ill = 
Pid — Py) + 1 — PpPs 


Thus, the probability that the test will assert that P2 > P is equal to the probability 
that a gambler who wins each (one-unit) bet with probability P will go down M before 
going up M. But Equation (4.5), with i = M,N = 2M, shows that this probability is 
given by 
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P{test asserts that P2 > Py} 


_ M 
ee 
i) 


_ i 
7 {i — pi" 
1 
+( P ) 
_ 1 
ee 
where 
P Ml = £3) 
y _ 


“=P PtP) 


For instance, if P} = .6 and P2 = .4, then the probability of an incorrect decision is 
.017 when M = 5 and reduces to .0003 when M = 10. | 


Suppose that we are presented with a set of elements and we want to determine 
whether at least one member of the set has a certain property. We can attack this 
question probabilistically by randomly choosing an element of the set in such a way 
that each element has a positive probability of being selected. Then the original ques- 
tion can be answered by a consideration of the probability that the randomly selected 
element does not have the property of interest. If this probability is equal to 1, then 
none of the elements of the set have the property; if it is less than 1, then at least one 
element of the set has the property. 

The final example of this section illustrates this technique. 


EXAMPLE 4m 


The complete graph having n vertices is defined to be a set of n points (called vertices) 
in the plane and the : lines (called edges) connecting each pair of vertices. The 
complete graph having 3 vertices is shown in Figure 3.3. Suppose now that each edge 
in a complete graph having n vertices is to be colored either red or blue. For a fixed 
integer k, a question of interest is, Is there a way of coloring the edges so that no set 
of k vertices has all of its : connecting edges the same color? It can be shown by 
a probabilistic argument that if n is not too large, then the answer is yes. 


FIGURE 3.3 
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The argument runs as follows: Suppose that each edge is, independently, equally 
likely to be colored either red or blue. That is, each edge is red with probability 5. 


Number the (Z) sets of k vertices and define the events E;,i = 1,..., ( 7 \ as 


k 
follows: 
E; = {all of the connecting edges of the ith set 
of k vertices are the same color} 


Now, since each of the ( : ) connecting edges of a set of k vertices is equally likely to 


be either red or blue, it follows that the probability that they are all the same color is 


1 k(k-1)/2 
PE)=2 (5) 


Therefore, because 


P Ua =) P(E;) (Boole’s inequality) 
: 


L 


we find that P| (J E; }, the probability that there is a set of k vertices all of whose 


L 
connecting edges are similarly colored, satisfies 


- 1\ K&-D/2-1 
= Uzi = (7) (5) 
i 


( e ) Ca ; 
k )\3 i 
n k(k—1)/2-1 
@ <2 


then the probability that at least one of the es sets of k vertices has all of its 


Hence, if 


or, equivalently, if 


connecting edges the same color is less than 1. Consequently, under the preceding 
condition on n and k, it follows that there is a positive probability that no set of k 
vertices has all of its connecting edges the same color. But this conclusion implies 
that there is at least one way of coloring the edges for which no set of k vertices has 
all of its connecting edges the same color. | 


Remarks. (a) Whereas the preceding argument established a condition on n and 
k that guarantees the existence of a coloring scheme satisfying the desired property, 
it gives no information about how to obtain such a scheme (although one possibility 
would be simply to choose the colors at random, check to see if the resulting coloring 
satisfies the property, and repeat the procedure until it does). 
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(b) The method of introducing probability into a problem whose statement is 
purely deterministic has been called the probabilistic method.’ Other examples of this 
method are given in Theoretical Exercise 24 and Examples 2t and 2u of Chapter 7. 
3.5 P(-|F) IS A PROBABILITY 


Conditional probabilities satisfy all of the properties of ordinary probabilities, as is 
proved by Proposition 5.1, which shows that P(E|F) satisfies the three axioms of a 
probability. 


Proposition 5.1. 


(a) 0 S P(E|F) = 1. 
(b) P(S|F) = 1. 


(c) If Fj;,i=1,2,..., are mutually exclusive events, then 
(oe) CO 
P| J&AF| => PGiAlF/) 
1 1 


Proof. To prove part (a), we must show that 0 = P(EF)/P(F) = 1. The left-side 
inequality is obvious, whereas the right side follows because EF C F, which implies 
that P(EF) =< P(F). Part (b) follows because 


P(SF) — PCF) 


PIP) = Say = Pa = 


Part (c) follows from 


ou) 0 


P(F) 


P (0 Bi) . . 
1 : 
~ Pe (0 | F= EF 


\ > PEF) 
1 
~ PF) 
=) PCEIIF) 
1 


where the next-to-last equality follows because E;E; = @ implies that 
E,\FEF = ©. 


See N. Alon, J. Spencer, and P. Erdos, The Probabilistic Method (New York: John Wiley & 
Sons, Inc., 1992). 
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If we define Q(E) = P(E|F), then, from Proposition 5.1, Q(E) may be regarded 
as a probability function on the events of S. Hence, all of the propositions previously 
proved for probabilities apply to Q(£). For instance, we have 


O(E, U Ey) = Q(Ei) + Q(E2) — QCA £2) 
or, equivalently, 
P(E, U Bo|F) = PURA|P) + P(E2|F) — PCE, E2I|F) 


Also, if we define the conditional probability OQ(£,|E2) by Q(E,|E2) = Q(E,E2)/ 
Q(£2), then, from Equation (3.1), we have 


QO(E}) = Q(E;|E2)QO(E2) + Q(E1|E5)Q(ES) (5.1) 


Since 


O(E\E2) 
ja ce 
O(E\|E2) O(E) 


_ P(E, Ey|F) 
~ P(E9|F) 

P(E\ FF) 
= 28) 
P(EoF) 
PP) 

= P(E, |E2F) 


Equation (5.1) is equivalent to 


P(E, |F) = P(E\|E2F)P(E2|F) + PCE|\|E5F)P(E5|F) 


EXAMPLE 5a 


Consider Example 3a, which is concerned with an insurance company which believes 
that people can be divided into two distinct classes: those who are accident prone 
and those who are not. During any given year, an accident-prone person will have an 
accident with probability .4, whereas the corresponding figure for a person who is not 
prone to accidents is .2. What is the conditional probability that a new policyholder 
will have an accident in his or her second year of policy ownership, given that the 
policyholder has had an accident in the first year? 


Solution. If we let A be the event that the policyholder is accident prone and we let 
Aj,i = 1,2, be the event that he or she has had an accident in the ith year, then the 
desired probability P(A2|A,) may be obtained by conditioning on whether or not the 
policyholder is accident prone, as follows: 


P(A2|A1) = P(A2|AA1)P(A|A1) + P(A2|ACA1)P(A‘A1) 


Now, 
P(A{A) - P(A,|A)P(A) 
P(A) P(Aj) 


= 
10° 


P(A|A1) = 


However, P(A) is assumed to equal 
.26. Hence, 


and it was shown in Example 3a that P(A,) = 


(.4)(3) 6 


26 13 


P(A|Aj) = 
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Thus, 


7 
P(A‘|A)) =1 — P(A|Aj) = B 


Since P(A2|AA,) = .4 and P(A2|A‘A}) = .2, it follows that 


6 7 
P(A2|A1) = (Nig a (25 rw 29 


EXAMPLE 5b 


A female chimp has given birth. It is not certain, however, which of two male chimps 
is the father. Before any genetic analysis has been performed, it is felt that the 
probability that male number 1 is the father is p and the probability that male number 
2 is the father is 1 — p. DNA obtained from the mother, male number 1, and male 
number 2 indicate that, on one specific location of the genome, the mother has the 
gene pair (A, A), male number 1 has the gene pair (a, a), and male number 2 has the 
gene pair (A,a). If a DNA test shows that the baby chimp has the gene pair (A, a), 
what is the probability that male number 1 is the father? 


Solution. Let all probabilities be conditional on the event that the mother has the 
gene pair (A,A), male number 1 has the gene pair (a,a), and male number 2 has 
the gene pair (A,a). Now, let M; be the event that male number i, i = 1,2, is the 
father, and let B4, be the event that the baby chimp has the gene pair (A, a). Then 
P(M;,|B,.q) is obtained as follows: 


P(M, Baa) 
P(Baa) 
_ P(Ba a\M1)P™)) 
~ P(BAg\My)P(My) + P(BAa|\M2)P(M2) 


P(M|Baa) = 


- l-p 
te ps O20 = pi 
_ 2? 

~~ 1l4+p 


Because 3 > p when p < 1, the information that the baby’s gene pair is (A, a) 
increases the probability that male number 1 is the father. This result is intuitive 
because it is more likely that the baby would have gene pair (A, a) if M, is true than 
if Mp is true (the respective conditional probabilities being 1 and 1/2). | 


The next example deals with a problem in the theory of runs. 


EXAMPLE 5c 


Independent trials, each resulting in a success with probability p or a failure with 
probability g = 1 — p, are performed. We are interested in computing the probability 
that a run of n consecutive successes occurs before a run of m consecutive failures. 


Solution. Let E be the event that a run of 1 consecutive successes occurs before a run 
of m consecutive failures. To obtain P(E), we start by conditioning on the outcome of 
the first trial. That is, letting H denote the event that the first trial results in a success, 
we obtain 

P(E) = pP(E\H) + qP(E|H®) (5.2) 
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Now, given that the first trial was successful, one way we can get arun of n successes 
before a run of m failures would be to have the next n — 1 trials all result in successes. 
So, let us condition on whether or not that occurs. That is, letting F be the event that 
trials 2 through n all are successes, we obtain 


P(E|H) = P(E|\FH)P(F|H) + P(E|F°H)P(F|H) (5.3) 


On the one hand, clearly, PLE|FH) = 1; on the other hand, if the event F°H occurs, 
then the first trial would result in a success, but there would be a failure some time 
during the next n — 1 trials. However, when this failure occurs, it would wipe out all 
of the previous successes, and the situation would be exactly as if we started out with 
a failure. Hence, 


P(E\F°H) = P(E|H®) 


Because the independence of trials implies that F and H are independent, and because 
P(F) = p""!, it follows from Equation (5.3) that 


P(E|H) =p" + 0 — p®™)P(EIR®) (5.4) 


We now obtain an expression for P(E|H*) in a similar manner. That is, we let G 
denote the event that trials 2 through m are all failures. Then 


P(E|H®) = P(E|GH*)P(G|H*) + P(E|G°H)P(G‘|H*) (5.5) 


Now, GH‘ is the event that the first m trials all result in failures, so P(E|GH*) = 0. 
Also, if G°H* occurs, then the first trial is a failure, but there is at least one success 
in the next m — 1 trials. Hence, since this success wipes out all previous failures, we 
see that 


P(E|G°H*) = P(E|H) 
Thus, because P(G°|H°) = P(G*°) = 1 — q’~!, we obtain, from (5.5), 
P(E\H) = (1 — q"!)P(E|H) (5.6) 


Solving Equations (5.4) and (5.6) yields 


a4 
p” 
P(E\H) = prt ae qn-l _ pr-lqml 
and 
d-7 pe 
P(E|HS) = I I I I 
pe + qua _— p"- a 
Thus, 


P(E) = pP(E|H) + qP(E|H*) 
p" + qp™ 0 - q™") 
~~ p” aie qn} = pr-lqn- 
pot = q”) 
~ nl 4+ qm-1 _ yn—-lyqm-1 (5-7) 
P q P q 


1 
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It is interesting to note that, by the symmetry of the problem, the probability of 
obtaining a run of m failures before a run of n successes would be given by Equa- 
tion (5.7) with p and g interchanged and n and m interchanged. Hence, this probabil- 
ity would equal 


P{run of m failures before a run of n successes} 
-1 n 
gl =p") 
= ql A p"1 _ g”™lpn-1 (5.8) 


Since Equations (5.7) and (5.8) sum to 1, it follows that, with probability 1, either a 
run of 1 successes or a run of m failures will eventually occur. 

As an example of Equation (5.7), we note that, in tossing a fair coin, the probability 
that a run of 2 heads will precede a run of 3 tails is i For 2 consecutive heads before 


4 consecutive tails, the probability rises to 2. | 


In our next example, we return to the matching problem (Example 5m, Chapter 2) 
and this time obtain a solution by using conditional probabilities. 


EXAMPLE 5d 
At a party, n men take off their hats. The hats are then mixed up, and each man 
randomly selects one. We say that a match occurs if a man selects his own hat. What 
is the probability of 

(a) no matches? 

(b) exactly k matches? 


Solution. (a) Let E denote the event that no matches occur, and to make explicit the 
dependence on n, write P, = P(E). We start by conditioning on whether or not the 
first man selects his own hat—call these events M and M‘, respectively. Then 


Py = P(E) = P(E|M)P(M) + P(E|M)P(M) 


Clearly, P(E|M) = 0, so 
n—1 


Py=PE|M) (5.9) 
Now, P(E|M‘) is the probability of no matches when n — 1 men select from a set of 
n — 1 hats that does not contain the hat of one of these men. This can happen in either 
of two mutually exclusive ways: Either there are no matches and the extra man does 
not select the extra hat (this being the hat of the man who chose first), or there are 
no matches and the extra man does select the extra hat. The probability of the first of 
these events is just P,,_;, which is seen by regarding the extra hat as “belonging” to 
the extra man. Because the second event has probability [1/(m — 1)]P,—2, we have 


1 
P(E|M*) = Phy + ——~Pyh-2 
n-1 


Thus, from Equation (5.9), 


or, equivalently, 


1 
Ph — Phi = 7 Pn = Fa) (5.10) 
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However, since P,, is the probability of no matches when n men select among their 
own hats, we have 


1 
P, =0 Po = 5 
So, from Equation (5.10), 
(Ps =P) 1 
P3 P2= 3 = 31 or a 31 
(a Poy. 1 1 
ee fy BA oma rg 
and, in general, 
1 re me oe 
ra a Be gy 


(b) To obtain the probability of exactly k matches, we consider any fixed group of 

k men. The probability that they, and only they, select their own hats is 
1 1 1 P= (n — k)! P 
nn—1 n — (k — 1) ne nok 


n! 
where P,,_; is the conditional probability that the other n — k men, selecting among 
their own hats, have no matches. Since there are ( i ) choices of a set of k men, the 
desired probability of exactly k matches is 

i 1, | (—1)"-* 


Pre 2 BT" Hab! w 
k! k! 


An important concept in probability theory is that of the conditional independence 
of events. We say that the events FE; and E> are conditionally independent given F 
if, given that F occurs, the conditional probability that £; occurs is unchanged by 
information as to whether or not E> occurs. More formally, E; and E> are said to be 
conditionally independent given F if 


P(E\|E2F) = P(E\|F) (5.11) 


or, equivalently, 
P(E) Eo|F) = PE{|F)P(Ed|F) (5.12) 


The notion of conditional independence can easily be extended to more than two 
events, and this extension is left as an exercise. 

The reader should note that the concept of conditional independence was implic- 
itly employed in Example 5a, where it was assumed that the events that a policyholder 
had an accident in his or her ith year, i = 1,2,..., were conditionally independent 
given whether or not the person was accident prone. The following example, some- 
times referred to as Laplace’s rule of succession, further illustrates the concept of 
conditional independence. 


EXAMPLE 5e Laplace’s rule of succession 


There are k + 1 coins in a box. When flipped, the ith coin will turn up heads with 
probability i/k,i = 0,1,...,k. A coin is randomly selected from the box and is then 
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repeatedly flipped. If the first flips all result in heads, what is the conditional prob- 
ability that the (n + 1)st flip will do likewise? 


Solution. Let C; denote the event that the ith coin, i = 0,1,...,, is initially selected; 
let F,, denote the event that the first n flips all result in heads; and let H be the event 
that the (n + 1)st flip is a head. The desired probability, P(H|F,,), is now obtained as 


follows: 
k 


P(H|Fn) = >) PCH |FnCi)P(CilFn) 
i=0 


Now, given that the ith coin is selected, it is reasonable to assume that the outcomes 
will be conditionally independent, with each one resulting in a head with probability 
i/k. Hence, 

i 


P(A|F,Cj) = P(A|G) = k 


Also, 
P(Fy) k p 
So PIGNPG)  Lg/A"[L/k + DI 
j=0 0 
Thus, 
k 
KC ial 
P(H|F,) = =2—_ 


Yo G/b" 
j=0 


But if k is large, we can use the integral approximations 


1 k i n+1 1 | 1 
— _ y i d — 
a3 i ae eed 


So, for k large, 


n-+1 
PUHIFy) © ——— : 


EXAMPLE 5f Updating information sequentially 


Suppose there are n mutually exclusive and exhaustive possible hypotheses, with ini- 
tial (sometimes referred to as prior) probabilities P(H;), )~_, P(H;) = 1. Now, if 
information that the event E has occurred is received, then the conditional probabil- 
ity that H; is the true hypothesis (sometimes referred to as the updated or posterior 
probability of H;) is 

P(E| Hi) P(Hi) 


P(Hi\E) = 5 PEE PU) (5.13) 
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Suppose now that we learn first that E; has occurred and then that E2 has occurred. 
Then, given only the first piece of information, the conditional probability that H; is 
the true hypothesis is 


P(E} |Hi)PHi) — — PUE1|Hi) Pi) 


P(A;|E) = P(E) P(E Aj) P(A) 


whereas given both pieces of information, the conditional probability that H; is the 
true hypothesis is P(H;|E, E2), which can be computed by 
P(E) Eo|Hi) Pi) 
do PE £21 Aj) PCA) 


P(A, \E, Eo) = 


One might wonder, however, when one can compute P(H;|F£,E2) by using the 
right side of Equation (5.13) with E = E, and with P(H;) replaced by P(Hj|F;), 
j = 1,...,n. That is, when is it legitimate to regard P(Hj|£)), 7 = 1, as the prior 
probabilities and then use (5.13) to compute the posterior probabilities? 


Solution. The answer is that the preceding is legitimate, provided that, for each j = 
1,...,, the events F; and £2 are conditionally independent, given Hj. For if this is 
the case, then 

P(E, E2|Hj) = P(E2\Hj)P(E\|Hj), j= 1,....n 


Therefore, 
P(E£9|Hj) P(E) |i) P(A) 
P(E) £2) 
_ P(Eo|Hi) PE Ai) 
7 P(E) E) 
= P(Eo|Hj)P(Aj| £1) P(E)) 
P(E, £2) 
= P(E>|Hj)P(Ai\ £1) 
Q(1,2) 


where O(1,2) = - oe. Since the preceding equation is valid for alli, we obtain, 
upon summing, 


P(A, \E, Eo) = 


7 "\ P(E>\|H)) P(Aj\E 
1 = 0 PURE Ea) = ye 
i=1 i=1 i 


showing that 
n 
Q(1,2) = >> P(Ey|H) PAE) 
i=1 
and yielding the result 
P(£2|Hi) P(Ail 1) 


PUHj|E) £2) = ye PCnIADPA ED) 


For instance, suppose that one of two coins is chosen to be flipped. Let H; be the event 
that coin i, i = 1,2, is chosen, and suppose that when coin / is flipped, it lands on heads 
with probability p;, i = 1,2. Then the preceding equations show that, to sequentially 
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update the probability that coin 1 is the one being flipped, given the results of the 
previous flips, all that must be saved after each new flip is the conditional probability 
that coin 1 is the coin being used. That is, it is not necessary to keep track of all earlier 
results. a 


SUMMARY 


For events E and F, the conditional probability of FE given that F has occurred is 
denoted by P(E|F) and is defined by 


P(EF) 


P(E|F) = PUR. 


The identity 
P(E\ E+ ++ En) = P(E})P(E2|E1) ++» PUEn|E1 ++ En—1) 


is known as the multiplication rule of probability. 
A valuable identity is 


P(E) = P(E|F)P(F) + P(E|FP(F*) 


which can be used to compute P(E) by “conditioning” on whether F occurs. 
P(H)/P(H°*) is called the odds of the event H. The identity 


P(H\E) _ P(A) P(E|H) 
P(H°\E)  P(H°)P(E|H°) 


shows that when new evidence E is obtained, the value of the odds of H becomes its 
old value multiplied by the ratio of the conditional probability of the new evidence 
when H is true to the conditional probability when 4 is not true. 

Let Fj, i = 1,...,n, be mutually exclusive events whose union is the entire sample 
space. The identity 


P(E|F)) PCF) 
PURE) = | 
>> PEF) PF) 
i=l 
is known as Bayes’s formula. If the events Fj, i = 1,...,n, are competing hypotheses, 


then Bayes’s formula shows how to compute the conditional probabilities of these 
hypotheses when additional evidence E becomes available. 

If P(EF) = P(E)P(F), then we say that the events FE and F are independent. This 
condition is equivalent to P(E|F) = P(E) and to P(F|E) = P(F). Thus, the events E 
and F are independent if knowledge of the occurrence of one of them does not affect 
the probability of the other. 

The events £j,...,E, are said to be independent if, for any subset E;,,..., Fi, 
of them, 


P(E;, +++ Ei) = PUEx)--- P(Ei,) 


For a fixed event F, P(E|F) can be considered to be a probability function on the 
events FE of the sample space. 
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PROBLEMS 


Two fair dice are rolled. What is the conditional 
probability that at least one lands on 6 given that 
the dice land on different numbers? 

If two fair dice are rolled, what is the conditional 
probability that the first one lands on 6 given that 
the sum of the dice is 7? Compute for all values of 
i between 2 and 12. 

Use Equation (2.1) to compute, in a hand of 
bridge, the conditional probability that East has 
3 spades given that North and South have a com- 
bined total of 8 spades. 

What is the probability that at least one of a pair of 
fair dice lands on 6, given that the sum of the dice 
is i,i = 2,3,...,12? 

An urn contains 6 white and 9 black balls. If 4 balls 
are to be randomly selected without replacement, 
what is the probability that the first 2 selected are 
white and the last 2 black? 

Consider an urn containing 12 balls, of which 8 
are white. A sample of size 4 is to be drawn with 
replacement (without replacement). What is the 
conditional probability (in each case) that the first 
and third balls drawn will be white given that the 
sample drawn contains exactly 3 white balls? 

The king comes from a family of 2 children. What 
is the probability that the other child is his sister? 
A couple has 2 children. What is the probability 
that both are girls if the older of the two is a girl? 
Consider 3 urns. Urn A contains 2 white and 4 red 
balls, urn B contains 8 white and 4 red balls, and 
urn C contains 1 white and 3 red balls. If 1 ball is 
selected from each urn, what is the probability that 
the ball chosen from urn A was white given that 
exactly 2 white balls were selected? 

Three cards are randomly selected, without 
replacement, from an ordinary deck of 52 playing 
cards. Compute the conditional probability that 
the first card selected is a spade given that the sec- 
ond and third cards are spades. 

Two cards are randomly chosen without replace- 
ment from an ordinary deck of 52 cards. Let B be 
the event that both cards are aces, let A; be the 
event that the ace of spades is chosen, and let A be 
the event that at least one ace is chosen. Find 

(a) P(BIAs) 

(b) P(BIA) 

A recent college graduate is planning to take the 
first three actuarial examinations in the coming 
summer. She will take the first actuarial exam in 
June. If she passes that exam, then she will take 
the second exam in July, and if she also passes that 
one, then she will take the third exam in Septem- 
ber. If she fails an exam, then she is not allowed 
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to take any others. The probability that she passes 

the first exam is .9. If she passes the first exam, then 

the conditional probability that she passes the sec- 
ond one is .8, and if she passes both the first and 
the second exams, then the conditional probability 

that she passes the third exam is .7. 

(a) What is the probability that she passes all 
three exams? 

(b) Given that she did not pass all three exams, 
what is the conditional probability that she 
failed the second exam? 

Suppose that an ordinary deck of 52 cards (which 

contains 4 aces) is randomly divided into 4 hands 

of 13 cards each. We are interested in determining 

p, the probability that each hand has an ace. Let E; 

be the event that the ith hand has exactly one ace. 

Determine p = P(E, E2E3E4) by using the multi- 

plication rule. 

An urn initially contains 5 white and 7 black balls. 

Each time a ball is selected, its color is noted and 

it is replaced in the urn along with 2 other balls of 

the same color. Compute the probability that 

(a) the first 2 balls selected are black and the next 
2 are white; 

(b) of the first 4 balls selected, exactly 2 are black. 

An ectopic pregnancy is twice as likely to develop 

when the pregnant woman is a smoker as it is when 

she is a nonsmoker. If 32 percent of women of 
childbearing age are smokers, what percentage of 
women having ectopic pregnancies are smokers? 

Ninety-eight percent of all babies survive delivery. 

However, 15 percent of all births involve Cesarean 

(C) sections, and when a C section is performed, 

the baby survives 96 percent of the time. If a ran- 

domly chosen pregnant woman does not have a 

C section, what is the probability that her baby 

survives? 

In a certain community, 36 percent of the families 

own a dog and 22 percent of the families that own 

a dog also own a cat. In addition, 30 percent of the 

families own a cat. What is 

(a) the probability that a randomly selected fam- 
ily owns both a dog and a cat? 

(b) the conditional probability that a randomly 
selected family owns a dog given that it owns 
a cat? 

A total of 46 percent of the voters in a certain city 

classify themselves as Independents, whereas 30 

percent classify themselves as Liberals and 24 per- 

cent say that they are Conservatives. In a recent 

local election, 35 percent of the Independents, 62 

percent of the Liberals, and 58 percent of the Con- 

servatives voted. A voter is chosen at random. 
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Given that this person voted in the local election, 

what is the probability that he or she is 

(a) an Independent? 

(b) a Liberal? 

(c) a Conservative? 

(d) What fraction of voters participated in the 
local election? 

A total of 48 percent of the women and 37 percent 

of the men that took a certain “quit smoking” class 

remained nonsmokers for at least one year after 

completing the class. These people then attended 

a success party at the end of a year. If 62 percent 

of the original class was male, 

(a) what percentage of those attending the party 
were women? 

(b) what percentage of the original class attended 
the party? 

Fifty-two percent of the students at a certain col- 

lege are females. Five percent of the students in 

this college are majoring in computer science. Two 

percent of the students are women majoring in 

computer science. If a student is selected at ran- 

dom, find the conditional probability that 

(a) the student is female given that the student is 
majoring in computer science; 

(b) this student is majoring in computer science 
given that the student is female. 

A total of 500 married working couples were 

polled about their annual salaries, with the follow- 

ing information resulting: 


Husband 
Wife Less than More than 
$25,000 $25,000 
Less than $25,000 212 198 
More than $25,000 36 54 


For instance, in 36 of the couples, the wife earned 
more and the husband earned less than $25,000. If 
one of the couples is randomly chosen, what is 

(a) the probability that the husband earns less 
than $25,000? 

the conditional probability that the wife earns 
more than $25,000 given that the husband 
earns more than this amount? 

the conditional probability that the wife earns 
more than $25,000 given that the husband 
earns less than this amount? 


(b) 


(c) 


A red die, a blue die, and a yellow die (all six 
sided) are rolled. We are interested in the prob- 
ability that the number appearing on the blue die 
is less than that appearing on the yellow die, which 
is less than that appearing on the red die. That is, 
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with B, Y, and R denoting, respectively, the num- 
ber appearing on the blue, yellow, and red die, we 
are interested in P(B < Y < R). 


(a) What is the probability that no two of the dice 
land on the same number? 

(b) Given that no two of the dice land on the same 
number, what is the conditional probability 
that B < Y < R? 

(c) Whatis P(B < Y < R)? 

Urn I contains 2 white and 4 red balls, whereas urn 


II contains 1 white and 1 red ball. A ball is ran- 

domly chosen from urn IJ and put into urn II, and a 

ball is then randomly selected from urn II. What is 

(a) the probability that the ball selected from urn 
II is white? 

(b) the conditional probability that the trans- 
ferred ball was white given that a white ball 
is selected from urn IT? 

Each of 2 balls is painted either black or gold and 

then placed in an urn. Suppose that each ball is col- 

ored black with probability i and that these events 
are independent. 

(a) Suppose that you obtain information that the 

gold paint has been used (and thus at least 

one of the balls is painted gold). Compute 
the conditional probability that both balls are 
painted gold. 

Suppose now that the urn tips over and 1 ball 

falls out. It is painted gold. What is the prob- 

ability that both balls are gold in this case? 

Explain. 

The following method was proposed to estimate 

the number of people over the age of 50 who reside 

in a town of known population 100,000: “As you 
walk along the streets, keep a running count of the 
percentage of people you encounter who are over 

50. Do this for a few days; then multiply the per- 

centage you obtain by 100,000 to obtain the esti- 

mate.” Comment on this method. 


Hint: Let p denote the proportion of people in the 
town who are over 50. Furthermore, let a; denote 
the proportion of time that a person under the age 
of 50 spends in the streets, and let a2 be the cor- 
responding value for those over 50. What quantity 
does the method suggested estimate? When is the 
estimate approximately equal to p? 

Suppose that 5 percent of men and .25 percent 
of women are color blind. A color-blind person 
is chosen at random. What is the probability of 
this person being male? Assume that there are an 
equal number of males and females. What if the 
population consisted of twice as many males as 
females? 

All the workers at a certain company drive to 
work and park in the company’s lot. The company 


(b) 
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is interested in estimating the average number of 
workers in a car. Which of the following methods 
will enable the company to estimate this quantity? 
Explain your answer. 


1. Randomly choose n workers, find out how 
many were in the cars in which they were 
driven, and take the average of the n values. 


2. Randomly choose n cars in the lot, find out how 


many were driven in those cars, and take the 
average of the n values. 


Suppose that an ordinary deck of 52 cards is shuf- 
fled and the cards are then turned over one at a 
time until the first ace appears. Given that the first 
ace is the 20th card to appear, what is the condi- 
tional probability that the card following it is the 
(a) ace of spades? 

(b) two of clubs? 


There are 15 tennis balls in a box, of which 9 have 
not previously been used. Three of the balls are 
randomly chosen, played with, and then returned 
to the box. Later, another 3 balls are randomly 
chosen from the box. Find the probability that 
none of these balls has ever been used. 


Consider two boxes, one containing 1 black and 1 
white marble, the other 2 black and 1 white mar- 
ble. A box is selected at random, and a marble is 
drawn from it at random. What is the probability 
that the marble is black? What is the probability 
that the first box was the one selected given that 
the marble is white? 


Ms. Aquina has just had a biopsy on a possibly can- 
cerous tumor. Not wanting to spoil a weekend fam- 
ily event, she does not want to hear any bad news 
in the next few days. But if she tells the doctor to 
call only if the news is good, then if the doctor does 
not call, Ms. Aquina can conclude that the news is 
bad. So, being a student of probability, Ms. Aquina 
instructs the doctor to flip a coin. If it comes up 
heads, the doctor is to call if the news is good and 
not call if the news is bad. If the coin comes up 
tails, the doctor is not to call. In this way, even if 
the doctor doesn’t call, the news is not necessarily 
bad. Let a be the probability that the tumor is can- 
cerous; let 6 be the conditional probability that the 
tumor is cancerous given that the doctor does not 
call. 

(a) Which should be larger, a or 6B? 

(b) Find £ in terms of a, and prove your answer 


in part (a). 
A family has j children with probability p;, where 
Pi = -lp2 = .25,p3 = .35,p4 = .3. A child 


from this family is randomly chosen. Given that 
this child is the eldest child in the family, find the 
conditional probability that the family has 
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(a) only 1 child; 
(b) 4 children. 
Redo (a) and (b) when the randomly selected child 
is the youngest child of the family. 
On rainy days, Joe is late to work with probability 
.3; on nonrainy days, he is late with probability .1. 
With probability .7, it will rain tomorrow. 
(a) Find the probability that Joe is early tomor- 
row. 
(b) Given that Joe was early, what is the condi- 
tional probability that it rained? 
In Example 3f, suppose that the new evidence is 
subject to different possible interpretations and in 
fact shows only that it is 90 percent likely that the 
criminal possesses the characteristic in question. In 
this case, how likely would it be that the suspect is 
guilty (assuming, as before, that he has the charac- 
teristic)? 
With probability .6, the present was hidden by 
mom; with probability .4, it was hidden by dad. 
When mom hides the present, she hides it upstairs 
70 percent of the time and downstairs 30 percent 
of the time. Dad is equally likely to hide it upstairs 
or downstairs. 
(a) What is the probability that the present is 
upstairs? 
(b) Given that it is downstairs, what is the proba- 
bility it was hidden by dad? 
Stores A, B, and C have 50, 75, and 100 employees, 
respectively, and 50, 60, and 70 percent of them 
respectively are women. Resignations are equally 
likely among all employees, regardless of sex. One 
woman employee resigns. What is the probability 
that she works in store C? 
(a) A gambler has a fair coin and a two-headed 
coin in his pocket. He selects one of the coins 
at random; when he flips it, it shows heads. 
What is the probability that it is the fair coin? 
Suppose that he flips the same coin a second 
time and, again, it shows heads. Now what is 
the probability that it is the fair coin? 
Suppose that he flips the same coin a third 
time and it shows tails. Now what is the prob- 
ability that it is the fair coin? 
Urn A has 5 white and 7 black balls. Urn B has 
3 white and 12 black balls. We flip a fair coin. If 
the outcome is heads, then a ball from urn A is 
selected, whereas if the outcome is tails, then a ball 
from urn B is selected. Suppose that a white ball 
is selected. What is the probability that the coin 
landed tails? 
In Example 3a, what is the probability that some- 
one has an accident in the second year given that 
he or she had no accidents in the first year? 
Consider a sample of size 3 drawn in the following 
manner: We start with an urn containing 5 white 


(b) 


(c) 
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and 7 red balls. At each stage, a ball is drawn 
and its color is noted. The ball is then returned 
to the urn, along with an additional ball of the 
same color. Find the probability that the sample 
will contain exactly 

(a) 0 white balls; 

(b) 1 white ball; 

(c) 3 white balls; 

(d) 2 white balls. 

A deck of cards is shuffled and then divided into 
two halves of 26 cards each. A card is drawn from 
one of the halves; it turns out to be an ace. The ace 
is then placed in the second half-deck. The half is 
then shuffled, and a card is drawn from it. Com- 
pute the probability that this drawn card is an ace. 
Hint: Condition on whether or not the inter- 
changed card is selected. 

Three cooks, A, B, and C, bake a special kind of 
cake, and with respective probabilities .02, .03, and 
.05, it fails to rise. In the restaurant where they 
work, A bakes 50 percent of these cakes, B 30 per- 
cent, and C 20 percent. What proportion of “fail- 
ures” is caused by A? 

There are 3 coins in a box. One is a two-headed 
coin, another is a fair coin, and the third is a biased 
coin that comes up heads 75 percent of the time. 
When one of the 3 coins is selected at random and 
flipped, it shows heads. What is the probability that 
it was the two-headed coin? 

Three prisoners are informed by their jailer that 
one of them has been chosen at random to be 
executed and the other two are to be freed. Pris- 
oner A asks the jailer to tell him privately which of 
his fellow prisoners will be set free, claiming that 
there would be no harm in divulging this informa- 
tion because he already knows that at least one of 
the two will go free. The jailer refuses to answer 
the question, pointing out that if A knew which 
of his fellow prisoners were to be set free, then 
his own probability of being executed would rise 
from i to 5 because he would then be one of two 
prisoners. What do you think of the jailer’s 
reasoning? 

Suppose we have 10 coins such that if the ith 
coin is flipped, heads will appear with probabil- 
ity 1/10,i = 1,2,...,10. When one of the coins 
is randomly selected and flipped, it shows heads. 
What is the conditional probability that it was the 
fifth coin? 

In any given year, a male automobile policyholder 
will make a claim with probability p,, and a female 
policyholder will make a claim with probability pr, 
where pr # Pm. The fraction of the policyholders 
that are male is a,0 < a < 1. A policyholder is 
randomly chosen. If A; denotes the event that this 
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policyholder will make a claim in year i, show that 
P(A2|A1) > P(A) 


Give an intuitive explanation of why the preceding 
inequality is true. 
An urn contains 5 white and 10 black balls. A fair 
die is rolled and that number of balls is randomly 
chosen from the urn. What is the probability that 
all of the balls selected are white? What is the con- 
ditional probability that the die landed on 3 if all 
the balls selected are white? 
Each of 2 cabinets identical in appearance has 2 
drawers. Cabinet A contains a silver coin in each 
drawer, and cabinet B contains a silver coin in 
one of its drawers and a gold coin in the other. 
A cabinet is randomly selected, one of its drawers 
is opened, and a silver coin is found. What is the 
probability that there is a silver coin in the other 
drawer? 
Prostate cancer is the most common type of can- 
cer found in males. As an indicator of whether a 
male has prostate cancer, doctors often perform 
a test that measures the level of the prostate- 
specific antigen (PSA) that is produced only by the 
prostate gland. Although PSA levels are indica- 
tive of cancer, the test is notoriously unreli- 
able. Indeed, the probability that a noncancerous 
man will have an elevated PSA level is approx- 
imately .135, increasing to approximately .268 if 
the man does have cancer. If, on the basis of other 
factors, a physician is 70 percent certain that a 
male has prostate cancer, what is the conditional 
probability that he has the cancer given that 
(a) the test indicated an elevated PSA level? 
(b) the test did not indicate an elevated PSA 
level? 
Repeat the preceding calculation, this time assum- 
ing that the physician initially believes that there 
is a 30 percent chance that the man has prostate 
cancer. 
Suppose that an insurance company classifies peo- 
ple into one of three classes: good risks, average 
risks, and bad risks. The company’s records indi- 
cate that the probabilities that good-, average-, and 
bad-risk persons will be involved in an accident 
over a 1-year span are, respectively, .05, .15, and 
.30. If 20 percent of the population is a good risk, 
50 percent an average risk, and 30 percent a bad 
risk, what proportion of people have accidents in 
a fixed year? If policyholder A had no accidents 
in 1997, what is the probability that he or she is a 
good or average risk? 
A worker has asked her supervisor for a letter of 
recommendation for a new job. She estimates that 
there is an 80 percent chance that she will get the 
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job if she receives a strong recommendation, a 40 
percent chance if she receives a moderately good 
recommendation, and a 10 percent chance if she 
receives a weak recommendation. She further esti- 
mates that the probabilities that the recommenda- 
tion will be strong, moderate, and weak are .7, .2, 
and .1, respectively. 

(a) How certain is she that she will receive the 
new job offer? 

Given that she does receive the offer, how 
likely should she feel that she received a 
strong recommendation? a moderate recom- 
mendation? a weak recommendation? 

Given that she does not receive the job offer, 
how likely should she feel that she received a 
strong recommendation? a moderate recom- 
mendation? a weak recommendation? 


(b) 


(c) 


A high school student is anxiously waiting to 
receive mail telling her whether she has been 
accepted to a certain college. She estimates that 
the conditional probabilities of receiving notifica- 
tion on each day of next week, given that she is 
accepted and that she is rejected, are as follows: 


Day P(maillaccepted) P(maillrejected) 
Monday AS 05 
Tuesday .20 10 
Wednesday 25 10 
Thursday AS AS 
Friday 10 .20 


She estimates that her probability of being 

accepted is .6. 

(a) What is the probability that she receives mail 
on Monday? 

(b) What is the conditional probability that she 

received mail on Tuesday given that she does 

not receive mail on Monday? 

If there is no mail through Wednesday, what 

is the conditional probability that she will be 

accepted? 

(d) What is the conditional probability that she 
will be accepted if mail comes on Thursday? 

(e) What is the conditional probability that she 
will be accepted if no mail arrives that week? 


(c) 


A parallel system functions whenever at least one 
of its components works. Consider a parallel sys- 
tem of n components, and suppose that each com- 
ponent works independently with probability ft 
Find the conditional probability that component 1 
works given that the system is functioning. 


If you had to construct a mathematical model for 
events E and F, as described in parts (a) through 
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(e), would you assume that they were independent 
events? Explain your reasoning. 
(a) E is the event that a businesswoman has blue 
eyes, and F is the event that her secretary has 
blue eyes. 
E is the event that a professor owns a car, 
and F is the event that he is listed in the tele- 
phone book. 
E is the event that a man is under 6 feet tall, 
and F is the event that he weighs over 200 
pounds. 
Eis the event that a woman lives in the United 
States, and F is the event that she lives in the 
Western Hemisphere. 
F is the event that it will rain tomorrow, and 
F is the event that it will rain the day after 
tomorrow. 
In a class, there are 4 freshman boys, 6 freshman 
girls, and 6 sophomore boys. How many sopho- 
more girls must be present if sex and class are to 
be independent when a student is selected at ran- 
dom? 
Suppose that you continually collect coupons and 
that there are m different types. Suppose also that 
each time a new coupon is obtained, it is a type 
i coupon with probability p;,i = 1,...,m. Suppose 
that you have just collected your mth coupon. What 
is the probability that it is a new type? 
Hint: Condition on the type of this coupon. 
A simplified model for the movement of the price 
of a stock supposes that on each day the stock’s 
price either moves up 1 unit with probability p or 
moves down 1 unit with probability 1 — p. The 
changes on different days are assumed to be inde- 
pendent. 
(a) What is the probability that after 2 days the 
stock will be at its original price? 
(b) What is the probability that after 3 days the 
stock’s price will have increased by 1 unit? 
Given that after 3 days the stock’s price has 
increased by 1 unit, what is the probability 
that it went up on the first day? 
Suppose that we want to generate the outcome 
of the flip of a fair coin, but that all we have at 
our disposal is a biased coin which lands on heads 
with some unknown probability p that need not be 
equal to . Consider the following procedure for 
accomplishing our task: 


(b) 


(c) 


(d) 


(e) 


(c) 


1. Flip the coin. 

2. Flip the coin again. 

3. If both flips land on heads or both land on tails, 
return to step 1. 

4. Let the result of the last flip be the result of the 
experiment. 
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(a) Show that the result is equally likely to be 

either heads or tails. 

Could we use a simpler procedure that contin- 

ues to flip the coin until the last two flips are 

different and then lets the result be the out- 
come of the final flip? 

Independent flips of a coin that lands on heads 

with probability p are made. What is the proba- 

bility that the first four outcomes are 

(a) H, H,H, H? 

(b) 7T,H,H, H? 

(c) What is the probability that the pattern 7, H, 
H, H occurs before the pattern H, H, H, H? 

Hint for part (c): How can the pattern H, H, H, H 
occur first? 
The color of a person’s eyes is determined by a sin- 
gle pair of genes. If they are both blue-eyed genes, 
then the person will have blue eyes; if they are 
both brown-eyed genes, then the person will have 
brown eyes; and if one of them is a blue-eyed gene 
and the other a brown-eyed gene, then the per- 
son will have brown eyes. (Because of the latter 
fact, we say that the brown-eyed gene is dominant 
over the blue-eyed one.) A newborn child inde- 
pendently receives one eye gene from each of its 
parents, and the gene it receives from a parent is 
equally likely to be either of the two eye genes of 
that parent. Suppose that Smith and both of his 
parents have brown eyes, but Smith’s sister has 
blue eyes. 
(a) What is the probability that Smith possesses a 
blue-eyed gene? 
Suppose that Smith’s wife has blue eyes. What 
is the probability that their first child will have 
blue eyes? 
If their first child has brown eyes, what is the 
probability that their next child will also have 
brown eyes? 
Genes relating to albinism are denoted by A and 
a. Only those people who receive the a gene from 
both parents will be albino. Persons having the 
gene pair A, a are normal in appearance and, 
because they can pass on the trait to their off- 
spring, are called carriers. Suppose that a normal 
couple has two children, exactly one of whom is 
an albino. Suppose that the nonalbino child mates 
with a person who is known to be a carrier for 
albinism. 

(a) What is the probability that their first off- 
spring is an albino? 

(b) What is the conditional probability that their 
second offspring is an albino given that their 
firstborn is not? 

Barbara and Dianne go target shooting. Suppose 

that each of Barbara’s shots hits a wooden duck 

target with probability p,, while each shot of 


(b) 


(b) 


(c) 
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Dianne’s hits it with probability p2. Suppose that 
they shoot simultaneously at the same target. If 
the wooden duck is knocked over (indicating that 
it was hit), what is the probability that 

(a) both shots hit the duck? 

(b) Barbara’s shot hit the duck? 

What independence assumptions have you made? 


3.63. A and B are involved in a duel. The rules of the 
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3.65. 


3.66. 


3.67. 


duel are that they are to pick up their guns and 
shoot at each other simultaneously. If one or both 
are hit, then the duel is over. If both shots miss, 
then they repeat the process. Suppose that the 
results of the shots are independent and that each 
shot of A will hit B with probability p4, and each 
shot of B will hit A with probability pg. What is 
(a) the probability that A is not hit? 
(b) the probability that both duelists are hit? 
(c) the probability that the duel ends after the nth 
round of shots? 
(d) the conditional probability that the duel ends 
after the nth round of shots given that A is 
not hit? 
the conditional probability that the duel ends 
after the nth round of shots given that both 
duelists are hit? 
A true-—false question is to be posed to a husband- 
and-wife team on a quiz show. Both the husband 
and the wife will independently give the correct 
answer with probability p. Which of the following 
is a better strategy for the couple? 
(a) Choose one of them and let that person 
answer the question. 
Have them both consider the question, and 
then either give the common answer if they 
agree or, if they disagree, flip a coin to deter- 
mine which answer to give. 
In Problem 3.5, if p = .6 and the couple uses the 
strategy in part (b), what is the conditional prob- 
ability that the couple gives the correct answer 
given that the husband and wife (a) agree? (b) dis- 
agree? 
The probability of the closing of the ith relay in the 
circuits shown in Figure 3.4 is given by p;,i = 1, 2, 
3, 4, 5. If all relays function independently, what is 
the probability that a current flows between A and 
B for the respective circuits? 
Hint for (b): Condition on whether relay 3 closes. 
An engineering system consisting of m compo- 
nents is said to be a k-out-of-n system (k = n) 
if the system functions if and only if at least 
k of the n components function. Suppose that 
all components function independently of each 
other. 
(a) If the ith component functions with probabil- 
ity Pj,i = 1, 2, 3, 4, compute the probability 
that a 2-out-of-4 system functions. 


(e) 


(b) 
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(a) 


1 


3 


— 


—>—B 
5 


(b) 


<T 


FIGURE 3.4: Circuits for Problem 3.66 


(b) Repeat part (a) for a 3-out-of-5 system. 
(c) Repeat for a k-out-of-n system when all the P; 
equal p (that is, P) = p,i=1,2,...,n). 


3.68. In Problem 3.65a, find the conditional probability 


that relays 1 and 2 are both closed given that a cur- 
rent flows from A to B. 


3.69. A certain organism possesses a pair of each of 5 


different genes (which we will designate by the 
first 5 letters of the English alphabet). Each gene 
appears in 2 forms (which we designate by low- 
ercase and capital letters). The capital letter will 
be assumed to be the dominant gene, in the sense 
that if an organism possesses the gene pair xX, 
then it will outwardly have the appearance of the 
X gene. For instance, if X stands for brown eyes 
and x for blue eyes, then an individual having 
either gene pair XX or xX will have brown eyes, 
whereas one having gene pair xx will have blue 
eyes. The characteristic appearance of an organ- 
ism is called its phenotype, whereas its genetic 
constitution is called its genotype. (Thus, 2 organ- 
isms with respective genotypes aA, bB, cc, dD, 
ee and AA, BB, cc, DD, ee would have different 
genotypes but the same phenotype.) In a mating 
between 2 organisms, each one contributes, at ran- 
dom, one of its gene pairs of each type. The 5 
contributions of an organism (one of each of the 
5 types) are assumed to be independent and are 
also independent of the contributions of the organ- 
ism’s mate. In a mating between organisms hav- 
ing genotypes aA, bB, cC, dD, eE and aa, bB, cc, 
Dd, ee what is the probability that the progeny 
will (i) phenotypically and (ii) genotypically 
resemble 

(a) the first parent? 

(b) the second parent? 
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(c) either parent? 

(d) neither parent? 

There is a 50-50 chance that the queen carries the 
gene for hemophilia. If she is a carrier, then each 
prince has a 50-50 chance of having hemophilia. If 
the queen has had three princes without the dis- 
ease, what is the probability that the queen is a 
carrier? If there is a fourth prince, what is the prob- 
ability that he will have hemophilia? 

On the morning of September 30, 1982, the won- 
lost records of the three leading baseball teams in 
the Western Division of the National League were 
as follows: 


Team Won Lost 
Atlanta Braves 87 72 
San Francisco Giants 86 73 
Los Angeles Dodgers 86 73 


Each team had 3 games remaining. All 3 of the 
Giants’ games were with the Dodgers, and the 3 
remaining games of the Braves were against the 
San Diego Padres. Suppose that the outcomes of 
all remaining games are independent and each 
game is equally likely to be won by either partic- 
ipant. For each team, what is the probability that it 
will win the division title? If two teams tie for first 
place, they have a playoff game, which each team 
has an equal chance of winning. 

A town council of 7 members contains a steering 
committee of size 3. New ideas for legislation go 
first to the steering committee and then on to the 
council as a whole if at least 2 of the 3 commit- 
tee members approve the legislation. Once at the 
full council, the legislation requires a majority vote 


3.73. 


(of at least 4) to pass. Consider a new piece of 
legislation, and suppose that each town council 
member will approve it, independently, with prob- 
ability p. What is the probability that a given steer- 
ing committee member’s vote is decisive in the 
sense that if that person’s vote were reversed, 
then the final fate of the legislation would be 
reversed? What is the corresponding probability 
for a given council member not on the steering 
committee? 

Suppose that each child born to a couple is equally 
likely to be a boy or a girl, independently of the 
sex distribution of the other children in the fam- 
ily. For a couple having 5 children, compute the 
probabilities of the following events: 

(a) All children are of the same sex. 

(b) The 3 eldest are boys and the others girls. 

(c) Exactly 3 are boys. 

(d) The 2 oldest are girls. 

(e) There is at least 1 girl. 


3.74. A and B alternate rolling a pair of dice, stopping 
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either when A rolls the sum 9 or when B rolls the 
sum 6. Assuming that A rolls first, find the proba- 
bility that the final roll is made by A. 
In a certain village, it is traditional for the eldest 
son (or the older son in a two-son family) and 
his wife to be responsible for taking care of his 
parents as they age. In recent years, however, the 
women of this village, not wanting that responsi- 
bility, have not looked favorably upon marrying an 
eldest son. 
(a) If every family in the village has two children, 
what proportion of all sons are older sons? 
(b) If every family in the village has three chil- 
dren, what proportion of all sons are eldest 
sons? 
Assume that each child is, independently, equally 
likely to be either a boy or a girl. 
Suppose that FE and F are mutually exclusive 
events of an experiment. Show that if independent 
trials of this experiment are performed, then E 
will occur before F with probability P(E)/[P(E) + 
P(F)|. 
Consider an unending sequence of independent 
trials, where each trial is equally likely to result in 
any of the outcomes 1, 2, or 3. Given that outcome 
3 is the last of the three outcomes to occur, find the 
conditional probability that 
(a) the first trial results in outcome 1; 
(b) the first two trials both result in outcome 1. 


3.78. A and B play a series of games. Each game is inde- 


pendently won by A with probability p and by B 
with probability 1 — p. They stop when the total 
number of wins of one of the players is two greater 
than that of the other player. The player with the 
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greater number of total wins is declared the winner 

of the series. 

(a) Find the probability that a total of 4 games are 
played. 

(b) Find the probability that A is the winner of 
the series. 

In successive rolls of a pair of fair dice, what is the 

probability of getting 2 sevens before 6 even num- 

bers? 

In a certain contest, the players are of equal skill 

and the probability is 5 that a specified one of 

the two contestants will be the victor. In a group 

of 2” players, the players are paired off against 

each other at random. The 2”~! winners are again 

paired off randomly, and so on, until a single win- 

ner remains. Consider two specified contestants, A 

and B, and define the events A;,i = n, E by 


A;: A plays in exactly i contests: 
E: AandB never play each other. 
(a) Find P(A;),i=1,..., n. 


(b) Find P(E). 
(c) Let P,, = P(E). Show that 


f on 2 FPN" 
Pr= FP Ph-1 


2P—1\2 


and use this formula to check the answer you 
obtained in part (b). 

Hint: Find P(E) by conditioning on which of 
the events Aj,i = 1,...,” occur. In simplifying 
your answer, use the algebraic identity 


Sax! _ i nx"! 4 = 1)x" 

i=l =m) 
For another approach to solving this problem, 
note that there are a total of 2” — 1 games 
played. 
Explain why 2” — 1 games are played. 
Number these games, and let B; denote the 
event that A and B play each other in game 
ii=1,...,2" — 1. 
(e) What is P(B;)? 
(f) Use part (e) to find P(E). 
An investor owns shares in a stock whose present 
value is 25. She has decided that she must sell her 
stock if it goes either down to 10 or up to 40. If each 
change of price is either up 1 point with probabil- 
ity .55 or down 1 point with probability .45, and 
the successive changes are independent, what is 
the probability that the investor retires a winner? 


(d) 


3.82. A and B flip coins. A starts and continues flipping 


until a tail occurs, at which point B starts flipping 
and continues until there is a tail. Then A takes 
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over, and so on. Let P; be the probability of the 
coin’s landing on heads when A flips and P2 when 
B flips. The winner of the game is the first one 
to get 

(a) 2 heads in a row; 

(b) a total of 2 heads; 

(c) 3 heads in a row; 

(d) a total of 3 heads. 

In each case, find the probability that A wins. 

Die A has 4 red and 2 white faces, whereas die B 
has 2 red and 4 white faces. A fair coin is flipped 
once. If it lands on heads, the game continues with 
die A; if it lands on tails, then die B is to be used. 
(a) Show that the probability of red at any throw 
is 5. 

If the first two throws result in red, what is the 
probability of red at the third throw? 

If red turns up at the first two throws, what 
is the probability that it is die A that is being 
used? 

An urn contains 12 balls, of which 4 are white. 
Three players—A, B, and C—successively draw 
from the urn, A first, then B, then C, then A, and so 
on. The winner is the first one to draw a white ball. 
Find the probability of winning for each player if 
(a) each ball is replaced after it is drawn; 

(b) the balls that are withdrawn are not replaced. 
Repeat Problem 3.84 when each of the 3 players 
selects from his own urn. That is, suppose that 
there are 3 different urns of 12 balls with 4 white 
balls in each urn. 

Let S = {1,2,...,n} and suppose that A and B are, 
independently, equally likely to be any of the 2” 
subsets (including the null set and S itself) of S. 
(a) Show that 


(b) 
(c) 


P{A C B}= (3) 
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Hint: Let N(B) denote the number of ele- 
ments in B. Use 


P{AC B} =) P{AC BIN(B) = i}P{N(B) = 


=) 


Show that P{AB = @)} = (3)’. 


In Example Se, what is the conditional probability 
that the ith coin was selected given that the first 
trials all result in heads? 


In Laplace’s rule of succession (Example 5e), are 
the outcomes of the successive flips independent? 
Explain. 


A person tried by a 3-judge panel is declared guilty 

if at least 2 judges cast votes of guilty. Suppose 

that when the defendant is in fact guilty, each 

judge will independently vote guilty with proba- 

bility .7, whereas when the defendant is in fact 

innocent, this probability drops to .2. If 70 per- 

cent of defendants are guilty, compute the condi- 

tional probability that judge number 3 votes guilty 

given that 

(a) judges 1 and 2 vote guilty; 

(b) judges 1 and 2 cast 1 guilty and 1 not 
guilty vote; 

(c) judges 1 and 2 both cast not guilty votes. 

Let E;,i = 1,2,3 denote the event that judge 

i casts a guilty vote. Are these events inde- 

pendent. Are they conditionally independent? 

Explain. 


Suppose that m independent trials, each of which 
results in any of the outcomes 0, 1, or 2, with 
respective probabilities po, p;, and po, ey Dix=1, 
are performed. Find the probability that outcomes 
1 and 2 both occur at least once. 


THEORETICAL EXERCISES 


Show that if P(A) > 0, then 
P(AB|A) = P(ABIA U B) 


Let A C B. Express the following probabilities as 
simply as possible: 


P(A|B), P(A|B), P(BIA), P(BIA 


Consider a school community of m a with n; 


“ke Em = 


Consider the following two methods for eho 
a child: 


of them having i children, i = 1,. 


1. Choose one of the m families at random and 
then randomly choose a child from that family. 


k 
2. Choose one of the }° in; children at random. 
i=1 
Show that method 1 is more likely than method 2 
to result in the choice of a firstborn child. 
Hint: In solving this problem, you will need to 
show that 


an 


k k 
ra = yonder 


i=1 j=l m1 jel 


k k a 
yin 


~~ 
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To do so, multiply the sums and show that, for all 
pairs i, j, the coefficient of the term njnj; is greater 
in the expression on the left than in the one on the 
right. 

A ball is in any one of n boxes and is in the ith box 
with probability P;. If the ball is in box i, a search of 
that box will uncover it with probability a;. Show 
that the conditional probability that the ball is in 
box j, given that a search of box i did not uncover 
it, is 


P; tii 
—*__ jj 
1 — a;P; =" 
Q-a@)Pi .._; 
1 — a;P; a 


An event F is said to carry negative information 
about an event £, and we write F N E, if 


P(E|F) < P(E) 


Prove or give counterexamples to the following 
assertions: 

(a) IfFNE,then EN F. 

(b) If FN Eand ENG, then FN G. 

(c) IfF \EandGNE, then FGN E. 

Repeat parts (a), (b), and (c) when N is replaced 
by 7, where we say that F carries positive informa- 
tion about E, written F 7 E, when P(E|F) = P(E). 
Prove that if F,,Fo,...,E, are independent 
events, then 


P(E, U Ey V+ U Ey) =1 - Tf — Pe] 
i=1 


(a) An urn contains n white and m black balls. 
The balls are withdrawn one at a time until 
only those of the same color are left. Show 
that, with probability n/(n + m), they are all 
white. 

Hint: Imagine that the experiment continues 
until all the balls are removed, and consider 
the last ball withdrawn. 

A pond contains 3 distinct species of fish, 
which we will call the Red, Blue, and Green 
fish. There are r Red, b Blue, and g Green fish. 
Suppose that the fish are removed from the 
pond in a random order. (That is, each selec- 
tion is equally likely to be any of the remain- 
ing fish.) What is the probability that the Red 
fish are the first species to become extinct in 
the pond? 

Hint: Write P{R} = P{RBG} + P{RGB}, 
and compute the probabilities on the right 
by first conditioning on the last species to be 
removed. 


(b) 
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Let A, B, and C be events relating to the experi- 
ment of rolling a pair of dice. 
(a) If 
P(A|C) > P(BIC) and P(A|C‘) > P(BIC*) 
either prove that P(A) > P(B) or give a coun- 
terexample by defining events A, B, and C for 
which that relationship is not true. 
(b) If 
P(A|C) > P(A|CS) and P(B|C) > P(B|C*) 
either prove that P(AB|C) > P(AB|C*‘) or 
give a counterexample by defining events 
A, B, and C for which that relationship is not 
true. 
Hint: Let C be the event that the sum of a pair of 
dice is 10; let _A be the event that the first die lands 
on 6; let B be the event that the second die lands 
on 6. 
Consider two independent tosses of a fair coin. Let 
A be the event that the first toss results in heads, let 
B be the event that the second toss results in heads, 
and let C be the event that in both tosses the coin 
lands on the same side. Show that the events A, B, 
and C are pairwise independent—that is, A and B 
are independent, A and C are independent, and B 
and C are independent—but not independent. 
Consider a collection of n individuals. Assume that 
each person’s birthday is equally likely to be any of 
the 365 days of the year and also that the birthdays 
are independent. Let A;;, i # j, denote the event 
that persons i and j have the same birthday. Show 
that these events are pairwise independent, but not 
independent. That is, show that A;; and A; ; are 
n 


independent, but the ( 7 


) events A; j,i # j are not 


independent. 

In each of 1 independent tosses of a coin, the coin 
lands on heads with probability p. How large need 
n be so that the probability of obtaining at least 
one head is at least 5? 

Show that 0 = a; = 1,i=1,2,..., then 


CO 


ye 


i=1 


i-1 oo 
ai] [a aj) t [[q aj) =1 

j=l i=1 
Hint: Suppose that an infinite number of coins are 
to be flipped. Let a; be the probability that the ith 
coin lands on heads, and consider when the first 
head occurs. 
The probability of getting a head on a single toss 
of a coin is p. Suppose that A starts and continues 
to flip the coin until a tail shows up, at which point 
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B starts flipping. Then B continues to flip until a 
tail comes up, at which point A takes over, and so 
on. Let Pym denote the probability that A accu- 
mulates a total of n heads before B accumulates 
m. Show that 


Pram = pPh_-1im +d - pd = Pmapn) 


Suppose that you are gambling against an infinitely 
rich adversary and at each stage you either win 
or lose 1 unit with respective probabilities p and 
1 — p. Show that the probability that you eventu- 
ally go broke is 


1 ifp< 
(q/p)' ifp > 


NIR NI 


where gq = 1 — pand where /is your initial fortune. 
Independent trials that result in a success with 
probability p are successively performed until a 
total of r successes is obtained. Show that the prob- 
ability that exactly n trials are required is 


("2p )ea-p 


Use this result to solve the problem of the points 
(Example 4j). 

Hint: In order for it to take n trials to obtain r suc- 
cesses, how many successes must occur in the first 
n — 1 trials? 

Independent trials that result in a success with 
probability p and a failure with probability 1 — 
p are called Bernoulli trials. Let P, denote the 
probability that m Bernoulli trials result in an even 
number of successes (0 being considered an even 
number). Show that 


Py =p — Pri) + A — p)Pn-1 n=l 


and use this formula to prove (by induction) that 


_1+(— 2p" 


Pr 2 


Suppose that m independent trials are performed, 

with trial i being a success with probability 1/(2i + 

1). Let P, denote the probability that the total 

number of successes that result is an odd number. 

(a) Find P, forn = 1,2,3,4,5. 

(b) Conjecture a general formula for P,. 

(c) Derive a formula for P,, in terms of P,_1. 

(d) Verify that your conjecture in part (b) satisfies 
the recursive formula in part (d). Because the 
recursive formula has a unique solution, this 
then proves that your conjecture is correct. 
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Let Q,, denote the probability that no run of 3 con- 
secutive heads appears in 7 tosses of a fair coin. 
Show that 


1 1 1 
Qn = 5 Qn-1 =F qQ2n-2 “F gQn-3 
Q)=Q:=Q=1 


Find Qg. 

Hint: Condition on the first tail. 

Consider the gambler’s ruin problem, with the 
exception that A and B agree to play no more than 
n games. Let P,;,; denote the probability that A 
winds up with all the money when A starts with 
i and B starts with N — i. Derive an equation 
for Py; in terms of Py-1,j41 and P,_1,;-1, and 
compute P73, N =S. 

Consider two urns, each containing both white 
and black balls. The probabilities of drawing white 
balls from the first and second urns are, respec- 
tively, p and p’. Balls are sequentially selected with 
replacement as follows: With probability a, a ball 
is initially chosen from the first urn, and with prob- 
ability 1 — a, it is chosen from the second urn. The 
subsequent selections are then made according to 
the rule that whenever a white ball is drawn (and 
replaced), the next ball is drawn from the same 
urn, but when a black ball is drawn, the next ball is 
taken from the other urn. Let a, denote the prob- 
ability that the nth ball is chosen from the first urn. 
Show that 


On41 = An(p + p’ — I+1-p’ n= 1 


and use this formula to prove that 
1— p’ 1-—p’ 
= P 7 + a P 7 
=P =p 2—p =p 


pep = i 
Let P, denote the probability that the nth 
ball selected is white. Find P,. Also, compute 
limy—> 90 On and limy—soo Py. 
The Ballot Problem. In an election, candidate A 
receives n votes and candidate B receives m votes, 
where n > m. Assuming that all of the (7 + 
m)!/n! m! orderings of the votes are equally likely, 
let Pym denote the probability that A is always 
ahead in the counting of the votes. 
(a) Compute P21, P31,P32, P41, Pa2,P43- 
(b) Find Pag 5 Pade 
(c) On the basis of your results in parts (a) and 

(b), conjecture the value of Pym. 

(d) Derive a recursion for Pym in terms of Pp—1m 
and P;m—1 by conditioning on who receives 
the last vote. 


an 
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(e) Use part (d) to verify your conjecture in part 

(c) by an induction proof onn + m. 
As a simplified model for weather forecasting, sup- 
pose that the weather (either wet or dry) tomor- 
row will be the same as the weather today with 
probability p. Show that the weather is dry on Jan- 
uary 1, then P,,, the probability that it will be dry n 
days later, satisfies 


Py = (2p — 1)Pn-1 + (1 — p) n21 
Po=1 
Prove that 
1 1 
Pa= 5 + 5p — 1" n= 0 


A bag contains a white and b black balls. Balls 
are chosen from the bag according to the following 
method: 


1. A ball is chosen at random and is discarded. 

2. A second ball is then chosen. If its color is 
different from that of the preceding ball, it is 
replaced in the bag and the process is repeated 
from the beginning. If its color is the same, it is 
discarded and we start from step 2. 


In other words, balls are sampled and discarded 
until a change in color occurs, at which point the 
last ball is returned to the urn and the process 
starts anew. Let P,» denote the probability that 
the last ball in the bag is white. Prove that 


Hint: Use induction onk =a + Db. 
A round-robin tournament of n contestants is a 


tournament in which each of the pairs of 


contestants play each other exactly once, with the 
outcome of any play being that one of the contes- 
tants wins and the other loses. For a fixed integer 
k,k < n,a question of interest is whether it is pos- 
sible that the tournament outcome is such that, for 
every set of k players, there is a player who beat 
each member of that set. Show that if 


1 Rqn-k 
(x) [ - (3) | = 
then such an outcome is possible. 


Hint: Suppose that the results of the games are 
independent and that each game is equally likely 
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to be won by either contestant. Number the ( : 

sets of k contestants, and let B; denote the event 
that no contestant beat all of the k players in 
the ith set. Then use Boole’s inequality to bound 


P\UB;}. 
i 
Prove directly that 
P(E|F) = P(E|FG)P(G|F) + P(E|FG‘)P(G‘|F) 


Prove the equivalence of Equations (5.11) and 
(5.12). 

Extend the definition of conditional independence 
to more than 2 events. 

Prove or give a counterexample. If E; and E> are 
independent, then they are conditionally indepen- 
dent given F. 

In Laplace’s rule of succession (Example 5e), 
show that if the first n flips all result in heads, 
then the conditional probability that the next m 
flips also result in all heads is (n + 1)/(” + 
m + 1). 

In Laplace’s rule of succession (Example 5e), sup- 
pose that the first n flips resulted in r heads and 
n — r tails. Show that the probability that the 
(n + 1)st flip turns up heads is (r + 1)/(n + 2). To 
do so, you will have to prove and use the identity 


nim! 
(n+m-4+ 1)! 


1 
[ y"d — y)"dy= 


Hint: To prove the identity, let C(n,m) = 
i y"(1 — y)’"dy. Integrating by parts yields 


m 
CR = _ "he +t l,m — 1) 
Starting with C(n,0) = 1/(m + 1), prove the iden- 
tity by induction on m. 

Suppose that a nonmathematical, but philosophi- 
cally minded, friend of yours claims that Laplace’s 
rule of succession must be incorrect because it can 
lead to ridiculous conclusions. “For instance,” says 
he, “the rule states that if a boy is 10 years old, 
having lived 10 years, the boy has probability 5 of 
living another year. On the other hand, if the boy 
has an 80-year-old grandfather, then, by Laplace’s 
rule, the grandfather has probability ee of sur- 
viving another year. However, this is ridiculous. 
Clearly, the boy is more likely to survive an addi- 
tional year than the grandfather is.” How would 
you answer your friend? 
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Conditional Probability and Independence 


SELF-TEST PROBLEMS AND EXERCISES 


In a game of bridge, West has no aces. What is the 
probability of his partner’s having (a) no aces? (b) 
2 or more aces? (c) What would the probabilities 
be if West had exactly 1 ace? 


The probability that a new car battery functions 
for over 10,000 miles is .8, the probability that it 
functions for over 20,000 miles is .4, and the prob- 
ability that it functions for over 30,000 miles is .1. If 
anew car battery is still working after 10,000 miles, 
what is the probability that 

(a) its total life will exceed 20,000 miles? 

(b) its additional life will exceed 20,000 miles? 


How can 20 balls, 10 white and 10 black, be put 
into two urns so as to maximize the probability of 
drawing a white ball if an urn is selected at random 
and a ball is drawn at random from it? 


Urn A contains 2 white balls and 1 black ball, 
whereas urn B contains 1 white ball and 5 black 
balls. A ball is drawn at random from urn A and 
placed in urn B. A ball is then drawn from urn B. 
It happens to be white. What is the probability that 
the ball transferred was white? 


An urn has r red and w white balls that are ran- 
domly removed one at a time. Let R; be the event 
that the ith ball removed is red. Find 

(a) P(Ri) 

(b) P(Rs|R3) 

(c) P(R3|Rs) 

An urn contains b black balls and r red balls. One 
of the balls is drawn at random, but when it is 
put back in the urn, c additional balls of the same 
color are put in with it. Now, suppose that we 
draw another ball. Show that the probability that 
the first ball was black, given that the second ball 
drawn was red, is b/(b + r + c). 


A friend randomly chooses two cards, without 
replacement, from an ordinary deck of 52 playing 
cards. In each of the following situations, deter- 
mine the conditional probability that both cards 
are aces. 

(a) You ask your friend if one of the cards is the 
ace of spades, and your friend answers in the 
affirmative. 

You ask your friend if the first card selected 
is an ace, and your friend answers in the affir- 
mative. 

(c) You ask your friend if the second card 
selected is an ace, and your friend answers in 
the affirmative. 

You ask your friend if either of the cards 
selected is an ace, and your friend answers in 
the affirmative. 


(b) 


(d) 
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Show that 
P(H|E) P(A) P(E|H) 
P(G|E) P(G) P(E|G) 


Suppose that, before new evidence is observed, the 
hypothesis H is three times as likely to be true as 
is the hypothesis G. If the new evidence is twice 
as likely when G is true than it is when H is true, 
which hypothesis is more likely after the evidence 
has been observed? 

You ask your neighbor to water a sickly plant 

while you are on vacation. Without water, it will 

die with probability .8; with water, it will die with 
probability .15. You are 90 percent certain that 
your neighbor will remember to water the plant. 

(a) What is the probability that the plant will be 
alive when you return? 

(b) If the plant is dead upon your return, what is 
the probability that your neighbor forgot to 
water it? 

Six balls are to be randomly chosen from an urn 

containing 8 red, 10 green, and 12 blue balls. 

(a) What is the probability at least one red ball is 
chosen? 

(b) Given that no red balls are chosen, what is the 
conditional probability that there are exactly 
2 green balls among the 6 chosen? 

A type C battery is in working condition with prob- 

ability .7, whereas a type D battery is in work- 

ing condition with probability .4. A battery is ran- 
domly chosen from a bin consisting of 8 type C and 

6 type D batteries. 

(a) What is the probability that the battery 
works? 

(b) Given that the battery does not work, what is 
the conditional probability that it was a type 
C battery? 

Maria will take two books with her on a trip. Sup- 

pose that the probability that she will like book 1 

is .6, the probability that she will like book 2 is .5, 

and the probability that she will like both books 

is .4. Find the conditional probability that she will 

like book 2 given that she did not like book 1. 

Balls are randomly removed from an urn that ini- 

tially contains 20 red and 10 blue balls. 

(a) What is the probability that all of the red balls 
are removed before all of the blue ones have 
been removed? 

Now suppose that the urn initially contains 20 
red, 10 blue, and 8 green balls. 

(b) Now what is the probability that all of the red 
balls are removed before all of the blue ones 
have been removed? 
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(c) What is the probability that the colors are 
depleted in the order blue, red, green? 

(d) What is the probability that the group of blue 
balls is the first of the three groups to be 
removed? 

A coin having probability .8 of landing on heads 

is flipped. A observes the result—either heads or 

tails—and rushes off to tell B. However, with prob- 
ability .4, A will have forgotten the result by the 
time he reaches B. If A has forgotten, then, rather 
than admitting this to B, he is equally likely to tell 

B that the coin landed on heads or that it landed 

tails. (If he does remember, then he tells B the cor- 

rect result.) 

(a) What is the probability that B is told that the 
coin landed on heads? 

(b) What is the probability that B is told the cor- 
rect result? 

(c) Given that B is told that the coin landed on 
heads, what is the probability that it did in fact 
land on heads? 

In a certain species of rats, black dominates over 
brown. Suppose that a black rat with two black 
parents has a brown sibling. 
(a) What is the probability that this rat is a pure 
black rat (as opposed to being a hybrid with 
one black and one brown gene)? 
Suppose that when the black rat is mated with 
a brown rat, all 5 of their offspring are black. 
Now what is the probability that the rat is a 
pure black rat? 
In Problem 3.65b, find the probability that a 
current flows from A to B, by conditioning on 
whether relay 1 closes. 
Find the conditional probability that relay 3 is 
closed given that a current flows from A to B. 
For the k-out-of-n system described in 
Problem 3.67, assume that each component 
independently works with probability 5 Find the 
conditional probability that component 1 is work- 
ing, given that the system works, when 
(a) kK=1,n=2; 
(b) kK=2,n=3. 
Mr. Jones has devised a gambling system for win- 
ning at roulette. When he bets, he bets on red and 
places a bet only when the 10 previous spins of 
the roulette have landed on a black number. He 
reasons that his chance of winning is quite large 
because the probability of 11 consecutive spins 
resulting in black is quite small. What do you think 
of this system? 

Three players simultaneously toss coins. The coin 

tossed by A(B)[C] turns up heads with probability 

P(P2)[P3]. If one person gets an outcome differ- 

ent from those of the other two, then he is the odd 


(b) 


(a) 


(b) 
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man out. If there is no odd man out, the players flip 
again and continue to do so until they get an odd 
man out. What is the probability that A will be the 
odd man? 

Suppose that there are n possible outcomes of 
a trial, with outcome i resulting with probability 


n 
piri = 1,...,n, > pi = 1. If two independent tri- 


i=1 
als are observed, what is the probability that the 
result of the second trial is larger than that of the 
first? 
If A flips n + 1 and B flips n fair coins, show that 
the probability that A gets more heads than B is 5 
Hint: Condition on which player has more heads 
after each has flipped n coins. (There are three 
possibilities.) 
Prove or give counterexamples to the following 
statements: 
(a) If £ is independent of F and E is independent 
of G, then E is independent of F U G. 
If E is independent of F, and E is independent 
of G, and FG = @, then F is independent of 
FUG. 
If E is independent of F, and F is independent 
of G, and E is independent of FG, then G is 
independent of EF. 
Let A and B be events having positive probabil- 
ity. State whether each of the following statements 
is (i) necessarily true, (ii) necessarily false, or (iii) 
possibly true. 


(b) 


(c) 


(a) If A and B are mutually exclusive, then they 
are independent. 

(b) If A and B are independent, then they are 
mutually exclusive. 

(c) P(A) = P(B) = .6, and A and B are mutually 
exclusive. 

(d) P(A) = P(B) = .6, and A and B are indepen- 
dent. 

Rank the following from most likely to least likely 


to occur: 


1. A fair coin lands on heads. 

2. Three independent trials, each of which is a suc- 
cess with probability .8, all result in successes. 

3. Seven independent trials, each of which is a suc- 
cess with probability .9, all result in successes. 


Two local factories, A and B, produce radios. Each 
radio produced at factory A is defective with prob- 
ability .05, whereas each one produced at factory B 
is defective with probability .01. Suppose you pur- 
chase two radios that were produced at the same 
factory, which is equally likely to have been either 
factory A or factory B. If the first radio that you 
check is defective, what is the conditional proba- 
bility that the other one is also defective? 
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Show that if P(A|B) = 1, then P(B‘|A‘) = 1. 


An urn initially contains 1 red and 1 blue ball. 
At each stage, a ball is randomly withdrawn and 
replaced by two other balls of the same color. 
(For instance, if the red ball is initially chosen, 
then there would be 2 red and 1 blue ball in 
the urn when the next selection occurs.) Show 
by mathematical induction that the probability 
that there are exactly i red balls in the urn 
after n stages have been completed is al = 
ixn+ 1. 


A total of 2n cards, of which 2 are aces, are 
to be randomly divided among two players, with 
each player receiving cards. Each player is then 
to declare, in sequence, whether he or she has 
received any aces. What is the conditional proba- 
bility that the second player has no aces, given that 
the first player declares in the affirmative, when 
(a) n = 2? (b) n = 10? (c) nm = 100? To what 
does the probability converge as 1 goes to infinity? 
Why? 


Conditional Probability and Independence 


3.29. There are n distinct types of coupons, and 


each coupon obtained is, independently of prior 

types collected, of type i with probability pj, 

Vii Pi = 1. 

(a) Ifn coupons are collected, what is the proba- 
bility that one of each type is obtained? 

(b) Now suppose that py = pz =--- = pp = 1/n. 
Let FE; be the event that there are no type 
i coupons among the n collected. Apply the 
inclusion—exclusion identity for the probabil- 
ity of the union of events to P(U;Fj) to prove 
the identity 


n= De'({e — ky" 
k=0 


3.30. Show that, for any events EF and F, 


P(E\E U F) = P(E\F) 


Hint: Compute P(E|E U F) by conditioning on 
whether F occurs. 
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RANDOM VARIABLES 

DISCRETE RANDOM VARIABLES 

EXPECTED VALUE 

EXPECTATION OF A FUNCTION OF A RANDOM VARIABLE 
VARIANCE 

THE BERNOULLI AND BINOMIAL RANDOM VARIABLES 
THE POISSON RANDOM VARIABLE 

OTHER DISCRETE PROBABILITY DISTRIBUTIONS 
EXPECTED VALUE OF SUMS OF RANDOM VARIABLES 


4.10 PROPERTIES OF THE CUMULATIVE DISTRIBUTION FUNCTION 


4.1 


RANDOM VARIABLES 


Frequently, when an experiment is performed, we are interested mainly in some func- 
tion of the outcome as opposed to the actual outcome itself. For instance, in tossing 
dice, we are often interested in the sum of the two dice and are not really concerned 
about the separate values of each die. That is, we may be interested in knowing 
that the sum is 7 and may not be concerned over whether the actual outcome was 
(1, 6), (2, 5), (3, 4), (4, 3), (5, 2), or (6, 1). Also, in flipping a coin, we may be inter- 
ested in the total number of heads that occur and not care at all about the actual 
head-tail sequence that results. These quantities of interest, or, more formally, these 
real-valued functions defined on the sample space, are known as random variables. 
Because the value of a random variable is determined by the outcome of the exper- 
iment, we may assign probabilities to the possible values of the random variable. 


EXAMPLE la 


Suppose that our experiment consists of tossing 3 fair coins. If we let Y denote the 
number of heads that appear, then Y is a random variable taking on one of the values 
0, 1, 2, and 3 with respective probabilities 


PLY =0} = P((T,T,T)} = : 
PLY = 1} = P((7,T, A), (T,H,T),(,T,T)} = : 
P{Y = 2} = P{(T,H, A), (A,T, HA), (A, A, T)} = : 


P{Y = 3} = P((H,H,H)} = : 
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Since Y must take on one of the values 0 through 3, we must have 


3 3 
ta? || ea Sy Pe aa) 
i=0 i=0 
which, of course, is in accord with the preceding probabilities. a 


EXAMPLE 1b 


Three balls are to be randomly selected without replacement from an urn contain- 
ing 20 balls numbered 1 through 20. If we bet that at least one of the balls that are 
drawn has a number as large as or larger than 17, what is the probability that we 
win the bet? 


Solution. Let X denote the largest number selected. Then X is a random variable 
taking on one of the values 3,4,...,20. Furthermore, if we suppose that each of the 


( 2 ) possible selections are equally likely to occur, then 


i-1 
P{LX =i} : j= 3 20 (1.1) 
= lh = so Perera . 
20 
3 
Equation (1.1) follows because the number of selections that result in the event 
{X = i} is just the number of selections that result in the ball numbered i and two 


of the balls numbered 1 through i — 1 being chosen. Because there are clearly ( ; ) 


( ; 9 : ) such selections, we obtain the probabilities expressed in Equation (1.1), 


from which we see that 


fo 
= 
No 
a 


3 
20 20 
3 
(2) 
2 51 
P{X = 19} = ~—= = —— & 134 
7} 20 380 
3 
(2) 
2 34 
P{X = 18} = ——~ = -—— & 11 
20 285 A 
3 
(2) 
2 
PLX =17}) = 34 = = & 105 


oN 
No 
YS 
es 
= 
Oo 
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Hence, since the event {X = 17} is the union of the disjoint events {X = ij}, 
i= 17,18,19, 20, it follows that the probability of our winning the bet is given by 


P{X = 17} © 105 + 119 + 134 + .150 = .508 = 


EXAMPLE Ic 


Independent trials consisting of the flipping of a coin having probability p of coming 
up heads are continually performed until either a head occurs or a total of n flips is 
made. If we let XY denote the number of times the coin is flipped, then X is a random 
variable taking on one of the values 1,2,3,..., with respective probabilities 

P(X = 1} = P{H} =p 

P{X = 2} = P{(T, H)} = (1 — p)p 


P(X = 3} = PU(T,T,E} = (1 — p)*p 


P(X =n — 1} =P{(T,T,...,T, HM} =(1 — p)"’p 
od 
n—-2 


Paw SPT 20.7 POT onl WSO = py 
a ee! ee 


n-1 n-1 


As acheck, note that 
n n 
P| | \or=a | =) Pera 
i=1 i=1 
n—-1 
=) pd - pt + - py! 
isl 


1-— (1 — py" a4 
= t (] 
P| i-a@-p (1 — p) 


slp" 211 -p 


EXAMPLE Id 


Three balls are randomly chosen from an urn containing 3 white, 3 red, and 5 black 
balls. Suppose that we win $1 for each white ball selected and lose $1 for each red ball 
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selected. If we let XY denote our total winnings from the experiment, then X is a ran- 
dom variable taking on the possible values 0,+1,+2,+3 with respective probabilities 


P(X =0} = () : (1)()@) _ 55 


Gy 
mrenemeen-GE)-QQ) 2 


(2) (2) 
Pxaehery soe vas = 


3 
P{X = 3} = P{x 3 : : 
= 11\ 165 
3 
These probabilities are obtained, for instance, by noting that in order for X to 
equal 0, either all 3 balls selected must be black or 1 ball of each color must be 


selected. Similarly, the event {X = 1} occurs either if 1 white and 2 black balls are 
selected or if 2 white and 1 red is selected. As a check, we note that 


3 3 
Yo P{X =i} + VO P(X =-= =1 
i=0 i=l 


The probability that we win money is given by 


3 

5 1 
LP = 165 = 3 
i= 


EXAMPLE Ie 


Suppose that there are N distinct types of coupons and that each time one obtains a 
coupon, it is, independently of previous selections, equally likely to be any one of the 
N types. One random variable of interest is 7, the number of coupons that needs to 
be collected until one obtains a complete set of at least one of each type. Rather than 
derive P{T = n} directly, let us start by considering the probability that T is greater 
than n. To do so, fix n and define the events Aj, A,..., An as follows: A; is the event 
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that no type j coupon is contained among the first n coupons collected, j = 1,...,N. 
Hence, 


N 
P{T > n}=P||JA; 
j=l 


=) P(A) — >) >> P(Ay, Ap) + + 

J ji<h 
+ (1) SOS Pay Ag+ Ag) 
Ji<io<-'<ik 


+ (—1)8t1 P(A, Az +++ Aw) 


Now, Aj will occur if each of the n coupons collected is not of type j. Since each of the 
coupons will not be of type j with probability (VN — 1)/N, we have, by the assumed 
independence of the types of successive coupons, 


N= 1\" 
Pia) = ( N ) 


Also, the event A;,Aj;, will occur if none of the first n coupons collected is of either 
type j, or type j2. Thus, again using independence, we see that 


N — 2\" 
PA An) = ( N ) 


The same reasoning gives 


N—k\" 
PA An Ay) = ( ) 
and we see that, forn > 0, 
N-—1\" N\(N —-2\" N\ (N — 3\" 
roo aen st) - (2)? «(RY -- 
N N 1\" 
+eo"(w 7) (Wy) 


ECC : 


The probability that T equals m can now be obtained from the preceding formula by 
the use of 


P{T >n—-1}=P{T=n} + P{T > n} 


or, equivalently, 
P{T=n}=P{T >n-—- 1} -—- P{T > n} 


Another random variable of interest is the number of distinct types of coupons 
that are contained in the first n selections—call this random variable D,,. To compute 
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P{D, = k}, let us start by fixing attention on a particular set of k distinct types, 
and let us then determine the probability that this set constitutes the set of distinct 
types obtained in the first n selections. Now, in order for this to be the situation, it is 
necessary and sufficient that, of the first n coupons obtained, 


A: eachis one of these k types. 
B: each of these k types is represented. 


Now, each coupon selected will be one of the k types with probability k/N, so the 
probability that A will be valid is (k/N)”. Also, given that a coupon is of one of the k 
types under consideration, it is easy to see that it is equally likely to be of any one of 
these k types. Hence, the conditional probability of B given that A occurs is the same 
as the probability that a set of nm coupons, each equally likely to be any of k possible 
types, contains a complete set of all A types. But this is just the probability that the 
number needed to amass a complete set, when choosing among k types, is less than 
or equal to n and is thus obtainable from Equation (1.2) with k replacing N. Thus, 


we have 
k nh 
P(A) ={— 
(A) (x) 


k-1 won 
P(B|A) =1 — ». ( : (- = ‘) (—1)+1 
i=] 


Finally, as there are ( . ) possible choices for the set of k types, we arrive at 


P{D, =k} = ( ) P(AB) 


-(2)G) - 20) Gyo" 


Remark. Since one must collect at least N coupons to obtain a compete set, it 
follows that P{T > n} = 1ifn < N. Therefore, from Equation (1.2), we obtain the 
interesting combinatorial identity that, for integers1 =n < N, 


N-1 “Nn 
VCR yon 
i=1 ’ Ny 


which can be written as 


N-1 “\n 
(2) Ce cama 
Ll N 


i=0 
or, upon multiplying by (-1)“N" and letting j= N — i, 


N 


¥ (4 )recvit <0 1<n<N 
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For a random variable X, the function F defined by 
Fa) = P{X S x} —-co<x<o 


is called the cumulative distribution function, or, more simply, the distribution func- 
tion, of X. Thus, the distribution function specifies, for all real values x, the probability 
that the random variable is less than or equal to x. 

Now, suppose that a = b. Then, because the event {X = a} is contained in the 
event {X = )5}, it follows that F(a), the probability of the former, is less than or 
equal to F(b), the probability of the latter. In other words, F(x) is a nondecreas- 
ing function of x. Other general properties of the distribution function are given in 
Section 4.10. 


4.2 DISCRETE RANDOM VARIABLES 


A random variable that can take on at most a countable number of possible values is 
said to be discrete. For a discrete random variable X, we define the probability mass 
function p(a) of X by 


p(a) = P(X =a} 


The probability mass function p(a) is positive for at most a countable number of val- 
ues of a. That is, if XY must assume one of the values x1, x2,..., then 


p(x;) =O fori=1,2,... 
p(x) =0 _ for all other values of x 


Since X must take on one of the values x;, we have 


\ Pep =1 
i=1 


It is often instructive to present the probability mass function in a graphical format 
by plotting p(x;) on the y-axis against x; on the x-axis. For instance, if the probability 
mass function of X is 


1 1 1 
pO) = ri p(y) = 5 p2)= rl 


p(x) 


E ia 
x 
0 1 2 


FIGURE 4.1 


124 Chapter 4 


Random Variables 


p(x) 

OL 

36 

Ss 
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AL 

36 
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2 

36 
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L x 
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FIGURE 4.2 


we can represent this function graphically as shown in Figure 4.1. Similarly, a graph 
of the probability mass function of the random variable representing the sum when 
two dice are rolled looks like Figure 4.2. 


EXAMPLE 2a 


The probability mass function of a random variable X is given by p(i) = ca‘/il, 
i= 0,1,2,..., where A is some positive value. Find (a) P(X = 0} and (b) P{X > 2}. 


[oe) 
Solution. Since >° p(i) = 1, we have 
i=0 


co . 
which, because e* = )> x'/i!, implies that 
i=0 


ce =1 or c=e”* 


Hence, 
(a) P{X = 0} = e*°/0! =e 
(b) P{X > 2}=1 — P{X S$ 2}=1 — P{xX =0} — P{x=1} 


— P{X =2} 
jfe-* 
=1 a ie 

e e 5 P| 

The cumulative distribution function F can be expressed in terms of p(a) by 
Fa@= D> pix) 
allx<a 

If X is a discrete random variable whose possible values are x1,x2,x3,..., where 


xX, < xX2 < x3 < ---,then the distribution function F of X is a step function. That is, 
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the value of F is constant in the intervals [x;_1,x;) and then takes a step (or jump) of 
size p(x;) at x;. For instance, if X has a probability mass function given by 


1 1 1 1 
pl) = rr p(2) = 5 p3) = 8 pA = 8 


then its cumulative distribution function is 

a<l 
1lsa<2 
F(a) = 


2<=a <3 


3<=a <4 


4=a 


ron AiW BIR © 


This function is depicted graphically in Figure 4.3. 


F(a) 
IL — 
Z L o—— 
3L ——_ 
4 
1 
ain ———_ 
! L L ! a 
1 2 3 4 
FIGURE 4.3 


Note that the size of the step at any of the values 1, 2, 3, and 4 is equal to the 
probability that XY assumes that particular value. 


4.3 EXPECTED VALUE 


One of the most important concepts in probability theory is that of the expectation 
of a random variable. If X is a discrete random variable having a probability mass 
function p(x), then the expectation, or the expected value, of X, denoted by E[X], is 
defined by 


E[X]= >) xp@) 


xip(x)>0 


In words, the expected value of X is a weighted average of the possible values that 
X can take on, each value being weighted by the probability that XY assumes it. For 
instance, on the one hand, if the probability mass function of X is given by 


ik 
p(0) = 5 = p(1) 


then 
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is just the ordinary average of the two possible values, 0 and 1, that XY can assume. 
On the other hand, if 


0-2 ie 
PW= 3 P= 3 


eIx]=0(5) 1(3)=3 


is a weighted average of the two possible values 0 and 1, where the value 1 is given 
twice as much weight as the value 0, since p(1) = 2p(0). 

Another motivation of the definition of expectation is provided by the frequency 
interpretation of probabilities. This interpretation (partially justified by the strong 
law of large numbers, to be presented in Chapter 8) assumes that if an infinite sequence 
of independent replications of an experiment is performed, then, for any event E, 
the proportion of time that F occurs will be P(E). Now, consider a random vari- 
able X that must take on one of the values x1, x2,...x, with respective probabilities 
P(x1), P(x2),.-.,p (Xn), and think of X as representing our winnings in a single game of 
chance. That is, with probability p(x;) we shall win x; units i = 1,2,...,n. By the fre- 
quency interpretation, if we play this game continually, then the proportion of time 
that we win x; will be p(x;). Since this is true for all i,i = 1,2,...,”, it follows that our 
average winnings per game will be 


then 


> ap) = ELX] 
i=l 


EXAMPLE 3a 


Find E[X], where X is the outcome when we roll a fair die. 


Solution. Since p(1) = p(2) = p(3) = p(4) = p(S) = p(6) = %, we obtain 


anin(3)+2(2) 90) 4) 50)“ 


EXAMPLE 3b 


We say that J is an indicator variable for the event A if 


l= 1 if A occurs 
0 if A° occurs 
Find E[/]. 
Solution. Since p(1) = P(A), p(0) = 1 — P(A), we have 
E{I]| = P(A) 


That is, the expected value of the indicator variable for the event A is equal to the 
probability that A occurs. | 
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EXAMPLE 3c 


A contestant on a quiz show is presented with two questions, questions 1 and 2, which 
he is to attempt to answer in some order he chooses. If he decides to try question i 
first, then he will be allowed to go on to question j, j # i, only if his answer to question 
iis correct. If his initial answer is incorrect, he is not allowed to answer the other ques- 
tion. The contestant is to receive V; dollars if he answers question i correctly, i = 1,2. 
For instance, he will receive V; + V2 dollars if he answers both questions correctly. 
If the probability that he knows the answer to question iis P;,i = 1,2, which question 
should he attempt to answer first so as to maximize his expected winnings? Assume 
that the events £;,i = 1,2, that he knows the answer to question i are independent 
events. 


Solution. On the one hand, if he attempts to answer question 1 first, then he will win 


0 with probability 1 — P, 
V1 with probability P;(1 — P2) 
VY, + V2 with probability P; P2 


Hence, his expected winnings in this case will be 


ViPi0 — Po) + (Vy + V2)P1P2 


On the other hand, if he attempts to answer question 2 first, his expected winnings 
will be 


V2P2(1 — Pi) + (V1 + V2)PiP2 
Therefore, it is better to try question 1 first if 
ViPi(1 — P2) = V2P2(1 — Pr) 


or, equivalently, if 
Vari .. Voke 


taH  le2 


For example, if he is 60 percent certain of answering question 1, worth $200, correctly 
and he is 80 percent certain of answering question 2, worth $100, correctly, then he 
should attempt to answer question 2 first because 

(100) (.8) (200) (.6) 


400 = = 300 = 
5 | 


EXAMPLE 3d 


A school class of 120 students is driven in 3 buses to a symphonic performance. There 
are 36 students in one of the buses, 40 in another, and 44 in the third bus. When the 
buses arrive, one of the 120 students is randomly chosen. Let X denote the number 
of students on the bus of that randomly chosen student, and find ELX]. 


Solution. Since the randomly chosen student is equally likely to be any of the 120 
students, it follows that 
36 40 44 


3 1 11\ 1208 
1x] =36 (55) ! 40(5) ! 4(5)- 59 = 40.2667 
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However, the average number of students on a bus is 120/3 = 40, showing that the 
expected number of students on the bus of a randomly chosen student is larger than 
the average number of students on a bus. This is a general phenomenon, and it occurs 
because the more students there are on a bus, the more likely it is that a randomly 
chosen student would have been on that bus. As a result, buses with many students 
are given more weight than those with fewer students. (See Self-Test Problem 4.) 


Remark. The probability concept of expectation is analogous to the physical con- 
cept of the center of gravity of a distribution of mass. Consider a discrete random 
variable X having probability mass function p(x;),i = 1. If we now imagine a weight- 
less rod in which weights with mass p(x;),i = 1, are located at the points x;,i = 1 
(see Figure 4.4), then the point at which the rod would be in balance is known as the 
center of gravity. For those readers acquainted with elementary statics, it is now a 


simple matter to show that this point is at ELX]." | 
° ® e e 
- 0 al 2, 


p(-1)=.10, p(0)=.25, p(1)=.30, p(2)=.35 


a = center of gravity = .9 


FIGURE 4.4 


4.4 EXPECTATION OF A FUNCTION OF A RANDOM VARIABLE 


Suppose that we are given a discrete random variable along with its probability mass 
function and that we want to compute the expected value of some function of X, 
say, g(X). How can we accomplish this? One way is as follows: Since g(X) is itself a 
discrete random variable, it has a probability mass function, which can be determined 
from the probability mass function of X. Once we have determined the probability 
mass function of g(X), we can compute E[g(X)] by using the definition of expected 
value. 


EXAMPLE 4a 


Let X denote a random variable that takes on any of the values —1, 0, and 1 with 
respective probabilities 


PX =-Y=2 Pix =O=5 P{ixX=Y=3 
Compute ELX?]. 
Solution. Let Y = X*. Then the probability mass function of Y is given by 


AYSterxvah +x Si=5 
PLY = 0} = P(X =0} = .5 


Hence, 
E[X?] = E[Y] = 1(.5) + 0(.5) = .5 


1To prove this, we must show that the sum of the torques tending to turn the point around ELX] 


is equal to 0. That is, we must show that 0 = )°(x; — E[X])p(x;), which is immediate. 
i 
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Note that 
5 = E[X’] # (E[X])” = .01 ag 
Although the preceding procedure will always enable us to compute the expected 
value of any function of X from a knowledge of the probability mass function of X, 
there is another way of thinking about E|g(X)]: Since g(X) will equal g(x) whenever 
X is equal to x, it seems reasonable that E[g(X)] should just be a weighted average of 


the values g(x), with g(x) being weighted by the probability that X is equal to x. That 
is, the following result is quite intuitive: 


Proposition 4.1. 
If X is a discrete random variable that takes on one of the values x;,i = 1, with 
respective probabilities p(x;), then, for any real-valued function g, 


E[g(X)] = L8P (xi) 


Before proving this proposition, let us i that it is in accord with the results of 
Example 4a. Applying it to that example yields 
E{X7} = (-1)7(.2) + 07(.5) + 173) 
=1(.2 + .3) + 0(¢5) 
= 


which is in agreement with the result given in Example 4a. 


Proof of Proposition 4.1: The proof of Proposition 4.1 proceeds, as in the preceding 
verification, by grouping together all the terms in }* g(x;)p(x;) having the same value 


of g(x;). Specifically, suppose that y;,j = 1, represent the different values of g(x;),i= 1. 
Then, grouping all the g(x;) having the same value gives 


2 ser) = De Yo gap) 


J tg(i)=y; 


=) Dd) yes 
J lg@i=y; 

=doy Yo pe 
i te(x)=y; 

= >> yiPig(X) = yj} 
J 


= E[g(X)] 


EXAMPLE 4b 


A product that is sold seasonally yields a net profit of b dollars for each unit sold and 
a net loss of ¢ dollars for each unit left unsold when the season ends. The number of 
units of the product that are ordered at a specific department store during any season 
is a random variable having probability mass function p(i),i = 0. If the store must 
stock this product in advance, determine the number of units the store should stock 
so as to maximize its expected profit. 
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Solution. Let X denote the number of units ordered. If s units are stocked, then the 
profit—call it P(s)—-can be expressed as 


P(s)=bX —(s—- X)t EX Ss 
= sb ifX >s 


Hence, the expected profit equals 


AY 


E[P(s)] = ) [bi — (s — dep@ + Y> sbp@ 


i=0 i=s+1 
=(b + £)) ip@® — st p@ + sb] 1 - Do p@ 
i=0 i=0 i=0 


=(b+ 2) p@ — + Os) p@ + sb 


i=0 i=0 


AY 
=sb+ (b+ 4) G- s)p@ 
i=0 
To determine the optimum value of s, let us investigate what happens to the profit 


when we increase s by 1 unit. By substitution, we see that the expected profit in this 
case is given by 


s+1 

E[P(s + DJ=b +1) + © +H G-5- Dp@ 
=0 

=bs+1)+ (+0) G-s5- lp 
i=0 


Therefore, 


E[P(s + 1)] — E[P()]=b - 6+ 9) pW 
i=0 


Thus, stocking s + 1 units will be better than stocking s units whenever 


b 
YS pw < (4.1) 
i=0 b a 


Because the left-hand side of Equation (4.1) is increasing in s while the right-hand 
side is constant, the inequality will be satisfied for all values of s = s*, where s* is the 
largest value of s satisfying Equation (4.1). Since 


E[P(0O)] < --- < E[P(s*)] < E[P(s* + 1)] > E[Pos* + 2)] > --- 
it follows that stocking s* + 1 items will lead to a maximum expected profit. | 


EXAMPLE 4c Utility 


Suppose that you must choose one of two possible actions, each of which can result 
in any of n consequences, denoted as Cj,...,C,. Suppose that if the first action is 
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chosen, then consequence C; will result with probability p;,i = 1,...,n, whereas 
if the second action is chosen, then consequence C; will result with probability qj, 


n n 
i=1,...,n, where }° pj = > q; = 1. The following approach can be used to deter- 
i=1 i=1 

mine which action to choose: Start by assigning numerical values to the different 
consequences in the following manner: First, identify the least and the most desir- 
able consequences—call them c and C, respectively; give consequence c the value 0 
and give C the value 1. Now consider any of the other n — 2 consequences, say, Cj. To 
value this consequence, imagine that you are given the choice between either receiv- 
ing C; or taking part in a random experiment that either earns you consequence C 
with probability u or consequence c with probability 1 — u. Clearly, your choice will 
depend on the value of wu. On the one hand, if uw = 1, then the experiment is certain 
to result in consequence C, and since C is the most desirable consequence, you will 
prefer participating in the experiment to receiving C;. On the other hand, if u = 0, 
then the experiment will result in the least desirable consequence—namely, c—so in 
this case you will prefer the consequence C; to participating in the experiment. Now, 
as u decreases from | to 0, it seems reasonable that your choice will at some point 
switch from participating in the experiment to the certain return of C;, and at that 
critical switch point you will be indifferent between the two alternatives. Take that 
indifference probability u as the value of the consequence Cj. In other words, the 
value of C; is that probability wu such that you are indifferent between either receiv- 
ing the consequence C; or taking part in an experiment that returns consequence C 
with probability wu or consequence c with probability 1 — u. We call this indifference 
probability the utility of the consequence Cj, and we designate it as u(C;). 

To determine which action is superior, we need to evaluate each one. Consider the 
first action, which results in consequence C; with probability p;,i = 1,...,n. We can 
think of the result of this action as being determined by a two-stage experiment. In the 
first stage, one of the values 1,..., is chosen according to the probabilities p1,..., Dn; 
if value i is chosen, you receive consequence Cj. However, since Cj is equivalent to 
obtaining consequence C with probability u(C;) or consequence c with probability 
1 — u(QC;), it follows that the result of the two-stage experiment is equivalent to an 
experiment in which either consequence C or consequence c is obtained, with C being 
obtained with probability 

n 
Yo piu(Ci) 


Similarly, the result of choosing the second action is equivalent to taking part in an 
experiment in which either consequence C or consequence c is obtained, with C being 
obtained with probability 
n 
Yo qiu(C)) 
i=1 


Since C is preferable to c, it follows that the first action is preferable to the second 
action if 
n n 
Yi piu(C;) > D> qiu(Ci) 
i=1 i=1 


In other words, the worth of an action can be measured by the expected value of the 
utility of its consequence, and the action with the largest expected utility is the most 
preferable. @ 
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A simple logical consequence of Proposition 4.1 is Corollary 4.1. 
Corollary 4.1. Ifa and 5 are constants, then 
E[aX + b] =aE[X] + b 
Proof: 


ElaX + bl= ye (ax + b)p(x) 


xip(x)>0 

=a )~ xp) +b SY pa) 
xip(x)>0 xip(x)>0 

= aE|X] + b 


The expected value of a random variable X, E[X], is also referred to as the mean 
or the first moment of X. The quantity E[X”],n = 1, is called the nth moment of X. 
By Proposition 4.1, we note that 


EIX"]= > x"pwo 


xip(x)>0 


Given a random variable X along with its distribution function F, it would be 
extremely useful if we were able to summarize the essential properties of F by cer- 
tain suitably defined measures. One such measure would be E[X], the expected value 
of X. However, although E[X] yields the weighted average of the possible values of 
X, it does not tell us anything about the variation, or spread, of these values. For 
instance, although random variables W, Y, and Z having probability mass functions 
determined by 


W=0_ with probability 1 


. —1 with probability 5 
~ | 41 with probability 4 


5 —100 with probability 5 
~ |4100 with probability 4 


all have the same expectation—namely, 0—there is a much greater spread in the pos- 
sible values of Y than in those of W (which is a constant) and in the possible values 
of Z than in those of Y. 

Because we expect X to take on values around its mean E[X’], it would appear that 
a reasonable way of measuring the possible variation of X would be to look at how 
far apart X would be from its mean, on the average. One possible way to measure this 
variation would be to consider the quantity E[|X — |], where « = ELX]. However, 
it turns out to be mathematically inconvenient to deal with this quantity, so a more 
tractable quantity is usually considered—namely, the expectation of the square of the 
difference between X and its mean. We thus have the following definition. 
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Definition 


If X is a random variable with mean jz, then the variance of X, denoted by Var(X), 
is defined by 
Var(X) = E[(X — p)’] 


An alternative formula for Var(X) is derived as follows: 
Var(X) = E[(X — p)*] 

= o@ - wp) 
x 

= S00? — 2ux + w*)p(x) 
x 

=) °x’p(x) — 2nd > xp) + wD p@ 
x x x 


= E[X?] — 2? + pw? 
= E[X?] - yw? 


That is, 


Var(X) = E[X2] — (E[X])? 


In words, the variance of X is equal to the expected value of X* minus the square 
of its expected value. In practice, this formula frequently offers the easiest way to 
compute Var(X). 


EXAMPLE 5a 


Calculate Var(X) if X represents the outcome when a fair die is rolled. 


Solution. It was shown in Example 3a that ELX] = 5 Also, 


avicr(t) +2) +#@)<4() +#@) +€() 
-()o» 


Hence, 


2 
varxy = zs (5) = 35 


A useful identity is that, for any constants a and b, 


Var(aX + b)= a’Var(X) 


134 Chapter 4 Random Variables 


To prove this equality, let 1 = ELX] and note from Corollary 4.1 that E[aX + b] = 
au + b. Therefore, 


Vartax + 5) =2/@X + b = ap — D)"] 
= Ela’(X — p)’] 
= @WE[(X — y)?] 
= a’Var(X) 


Remarks. (a) Analogous to the means being the center of gravity of a distribu- 
tion of mass, the variance represents, in the terminology of mechanics, the moment 
of inertia. 

(b) The square root of the Var(X) is called the standard deviation of X, and we 
denote it by SD(X). That is, 


SD(X) = / Var(X) 


Discrete random variables are often classified according to their probability mass 
functions. In the next few sections, we consider some of the more common types. 


4.6 THE BERNOULLI AND BINOMIAL RANDOM VARIABLES 


Suppose that a trial, or an experiment, whose outcome can be classified as either a 
success or a failure is performed. If we let X¥ = 1 when the outcome is a success and 
X = 0 when it is a failure, then the probability mass function of X is given by 


pO) =P{xX =0}=1—p 


6.1 
pd) =P{X =1}=p (6:1) 


where p, 0 = p = 1, is the probability that the trial is a success. 

A random variable X is said to be a Bernoulli random variable (after the Swiss 
mathematician James Bernoulli) if its probability mass function is given by Equa- 
tions (6.1) for some p € (0,1). 

Suppose now that independent trials, each of which results in a success with prob- 
ability p and in a failure with probability 1 — p, are to be performed. If X represents 
the number of successes that occur in the n trials, then X is said to be a binomial 
random variable with parameters (n, p). Thus, a Bernoulli random variable is just a 
binomial random variable with parameters (1, p). 

The probability mass function of a binomial random variable having parameters 
(n, p) is given by 


pi) = re — py! §=0,1,...,0 (6.2) 


The validity of Equation (6.2) may be verified by first noting that the probability of 
any particular sequence of n outcomes containing 7 successes and n — i failures is, 
by the assumed independence of trials, p'(1 — p)"~'. Equation (6.2) then follows, 


: n : : . 
since there are ( F ) different sequences of the n outcomes leading to i successes and 


n — i failures. This perhaps can most easily be seen by noting that there are ( : ) 
different choices of the i trials that result in successes. For instance, if nm = 4,7 = 2, 


4 : : : 
then there are ( 7 ) = 6 ways in which the four trials can result in two successes, 
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namely, any of the outcomes (s,s, f, f), (s, f, 8, f), (8, f, f, 5), f, 8,5, f), fs, f, 8), and 
(f, f, 5, 5), where the outcome (s, s, f, f) means, for instance, that the first two trials 


are successes and the last two failures. Since each of these outcomes has probability 
p’(1 — p)* of occurring, the desired probability of two successes in the four trials 
is ( : ) 21 — py" 
2 )P py. 
Note that, by the binomial theorem, the probabilities sum to 1; that is, 


Yi p@® => (ni)p'd - py" =p +a-pl'=1 
i=0 i=0 
EXAMPLE 6a 


Five fair coins are flipped. If the outcomes are assumed independent, find the proba- 
bility mass function of the number of heads obtained. 


Solution. If we let X equal the number of heads (successes) that appear, then X 
is a binomial random variable with parameters (n =5,p= 3). Hence, by Equa- 


tion (6.2), 
i yie 4 
nx-a=(3)()'() = 
i 71y" ~S 
nx=0=(7)(3) (3) =3 
i\ 71\° . 10 
mean=(3)() ()-8 
ey fis f1\> 40 
nix=31=(3)(5) GG) =3 
iy? 71, Ss 
nix=4=(4)(5) GG) =a 
evi fi. 4 
nix=5=(3)(5) (3) = 2 n 
EXAMPLE 6b 


It is known that screws produced by a certain company will be defective with proba- 
bility .01, independently of each other. The company sells the screws in packages of 
10 and offers a money-back guarantee that at most 1 of the 10 screws is defective. 
What proportion of packages sold must the company replace? 


Solution. If X is the number of defective screws in a package, then X is a binomial 
random variable with parameters (10, .01). Hence, the probability that a package will 
have to be replaced is 


(i - Peee —presipe st = G (.01)°(.99)!0 — (?) (.01)!(.99)9 
= .004 


Thus, only .4 percent of the packages will have to be replaced. | 
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EXAMPLE 6c 


The following gambling game, known as the wheel of fortune (or chuck-a-luck), is 
quite popular at many carnivals and gambling casinos: A player bets on one of the 
numbers 1 through 6. Three dice are then rolled, and if the number bet by the player 
appears i times, i = 1,2,3, then the player wins / units; if the number bet by the player 
does not appear on any of the dice, then the player loses 1 unit. Is this game fair to 
the player? (Actually, the game is played by spinning a wheel that comes to rest on 
a slot labeled by three of the numbers 1 through 6, but this variant is mathematically 
equivalent to the dice version.) 


Solution. If we assume that the dice are fair and act independently of each other, 
then the number of times that the number bet appears is a binomial random variable 


with parameters (3, t): Hence, letting X denote the player’s winnings in the game, 


aN fi’ (5% 125 
px=—t'= (9) (5) (=) = 216 
ae gay FS 
pux=ti=(7) (3) (=) ~ 216 
aX FI? 7s)". 15 
pix=2}=(3)(§) (;) = 716 
a\ fie 7s? 1 
pix=3)=(3) (5) (=) ~ 216 


In order to determine whether or not this is a fair game for the player, let us calcu- 


late E[X]. From the preceding probabilities, we obtain 
125-4> 79 = A038 


we have 


E[X] = 


_-17 
~ 216 


Hence, in the long run, the player will lose 17 units per every 216 games he plays. 


In the next example, we consider the simplest form of the theory of inheritance as 
developed by Gregor Mendel (1822-1884). 


EXAMPLE 6d 


Suppose that a particular trait (such as eye color or left-handedness) of a person is 
classified on the basis of one pair of genes, and suppose also that d represents a dom- 
inant gene and r a recessive gene. Thus, a person with dd genes is purely dominant, 
one with rr is purely recessive, and one with rd is hybrid. The purely dominant and the 
hybrid individuals are alike in appearance. Children receive 1 gene from each parent. 
If, with respect to a particular trait, 2 hybrid parents have a total of 4 children, what is 
the probability that 3 of the 4 children have the outward appearance of the dominant 
gene? 


Solution. If we assume that each child is equally likely to inherit either of 2 genes 
from each parent, the probabilities that the child of 2 hybrid parents will have dd, 
rr, and rd pairs of genes are, respectively, 7 b and 7 Hence, since an offspring will 
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have the outward appearance of the dominant gene if its gene pair is either dd or rd, 
it follows that the number of such children is binomially distributed with parameters 


(4, 3). Thus, the desired probability is 


(3) (2) G@) a 
3 4 4 64 7 
EXAMPLE 6e 


Consider a jury trial in which it takes 8 of the 12 jurors to convict the defendant; that 
is, in order for the defendant to be convicted, at least 8 of the jurors must vote him 
guilty. If we assume that jurors act independently and that, whether or not the defen- 
dant is guilty, each makes the right decision with probability 6, what is the probability 
that the jury renders a correct decision? 


Solution. The problem, as stated, is incapable of solution, for there is not yet enough 
information. For instance, if the defendant is innocent, the probability of the jury’s 
rendering a correct decision is 


12 
Ss ( - ) gid — gy2-i 


whereas, if he is guilty, the probability of a correct decision is 


12 

S ( . ) al — ay? 

i=8 

Therefore, if w represents the probability that the defendant is guilty, then, by condi- 


tioning on whether or not he is guilty, we obtain the probability that the jury renders 
a correct decision: 


> 12 aid — ai 4a — >> 12 gi — 62-1 
a d F a d ; . 


EXAMPLE 6f 


A communication system consists of n components, each of which will, indepen- 
dently, function with probability p. The total system will be able to operate effectively 
if at least one-half of its components function. 


(a) For what values of p is a 5-component system more likely to operate effectively 
than a 3-component system? 


(b) In general, when is a (2k + 1)-component system better than a (2k — 1)- 
component system? 


Solution. (a) Because the number of functioning components is a binomial random 
variable with parameters (n, p), it follows that the probability that a 5-component 
system will be effective is 


(5) pa = py + (j )eta —p)+pP 
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whereas the corresponding probability for a 3-component system is 
3 
(3) ra —p) +p 
Hence, the 5-component system is better if 


10p°1 — p)* + Spt — p) + p> 3p°1 —- p) + P? 


which reduces to 


3 Ay Op 1) eS 0 
or 


1 
> = 
P95 


(b) In general, a system with 2k + 1 components will be better than one with 


2k — 1 components if (and only if) p > 5 To prove this, consider a system of 2k + 1 


components and let X denote the number of the first 2k — 1 that function. Then 
Pox, (effective) = PX =k + 1} + PX =kKhd — (1 — p)’) 


42 PIX =k = Ip? 


which follows because the (2k + 1)-component system will be effective if either 


(i) X=k+1; 
(ii) X = k and at least one of the remaining 2 components function; or 
(ili) X = k — 1 and both of the next 2 components function. 


Since 


P>,_1 (effective) = P{X = k} 
=P{X =k} 4+ Pix =k+4 1 


we obtain 


Pox41 (effective) — Po,_1 (effective) 
= P(X =k — jp? — (1 — pr PIX=hk} 


= ce | )ea — p)*p* — (1 — py’ aes ") pka — p)*! 


2k -—1 2k —1 2k —1 
=( ‘ ) pk — pip — 1 ~ pylsince (> |) = ( k ) 


1 
0 = 
> ba eae 
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4.6.1 Properties of Binomial Random Variables 


We will now examine the properties of a binomial random variable with parameters 
nand p. To begin, let us compute its expected value and variance. Now, 


n 


E[X*] =) vi* ( ss )p'a =p 


i=0 
Using the identity 


gives 


n-1 r n—-1)\., _ by letting 
=m Yi yet(" 5 pia = py j=i-l 
j=0 


= npE|(Y + 1)*"'] 
where Y is a binomial random variable with parameters n — 1, p. Setting k = 1 in the 
preceding equation yields 
E[X]=np 
That is, the expected number of successes that occur in 1 independent trials when 
each is a success with probability p is equal to np. Setting k = 2 in the preceding equa- 


tion, and using the preceding formula for the expected value of a binomial random 
variable yields 


E[X?] = npE[Y + 1] 
=np((n — Ip + 1] 
Since E[X] = np, we obtain 
Var(X) = E[X?] — (E[X)” 


=np[(n — 1)p + 1] — (mp)* 
=np(1 — p) 


Summing up, we have shown the following: 
If X is a binomial random variable with parameters n and p, then 


E|X] = np 
Var(X) = np(1 — p) 
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The following proposition details how the binomial probability mass function first 
increases and then decreases. 


Proposition 6.1. If X is a binomial random variable with parameters (n, p), where 
0 < p < 1, then as k goes from 0 ton, P{X = k} first increases monotonically and 
then decreases monotonically, reaching its largest value when k is the largest integer 
less than or equal to (n + 1)p. 


Proof. We prove the proposition by considering P{X¥ = k}/P{X = k — 1} and 
determining for what values of k it is greater or less than 1. Now, 


n!\ 


k n—-k 
PIX =ky Gomme? o~P) 
P(X =k — 1} n! ete aed 
G@-ki pepe 
_(n—k+ Up 
k(1 — p) 


Hence, P{X¥ =k} = P{X =k — 1} if and onlyif 
(n—k + 1)pp=k(1 — p) 
or, equivalently, if and only if 
k=(n+ 1)p 
and the proposition is proved. a 


As an illustration of Proposition 6.1 consider Figure 4.5, the graph of the probabil- 
ity mass function of a binomial random variable with parameters (10, 5) 


EXAMPLE 6g 
In a USS. presidential election, the candidate who gains the maximum number of 
votes in a state is awarded the total number of electoral college votes allocated to 


1024 x p(k) 


252|- 


210} 

120|- 

45+ 
1 a a 
0 1 2 3 4 5 6 7 8 9 


10 
FIGURE 4.5 Graph of p(k) = (') (3) 


me 
10 


Section 4.6 The Bernoulli and Binomial Random Variables 141 


that state. The number of electoral college votes of a given state is roughly propor- 
tional to the population of that state—that is, a state with population n has roughly 
nc electoral votes. (Actually, it is closer to nc + 2, as a state is given an electoral 
vote for each member it has in the House of Representatives, with the number of 
such representatives being roughly proportional to the population of the state, and 
one electoral college vote for each of its two senators.) Let us determine the average 
power of a citizen in a state of size n in a close presidential election, where, by average 
power in a close election, we mean that a voter in a state of size n = 2k + 1 will be 
decisive if the other m — 1 voters split their votes evenly between the two candidates. 
(We are assuming here that n is odd, but the case where n is even is quite similar.) 
Because the election is close, we shall suppose that each of the other n — 1 = 2k 
voters acts independently and is equally likely to vote for either candidate. Hence, 
the probability that a voter in a state of size n = 2k + 1 will make a difference to 
the outcome is the same as the probability that 2k tosses of a fair coin land heads and 
tails an equal number of times. That is, 


P{voter in state of size 2k + 1 makes a difference} 


7 2k 1 k 1 k 

=(7)G) G) 
(2k)! 

~ Ki k122k 


To approximate the preceding equality, we make use of Stirling’s approximation, 
which says that, for k large, 


kl ~ kek /an 


where we say that a, ~ b,x when the ratio a;/b, approaches 1 as k approaches oo. 
Hence, it follows that 


P{voter in state of size 2k + 1 makes a difference} 
(2k)2k41/2 9—2k Ix a 1 
k2k+1 e—2k (2m) 22k ~ = 


Because such a voter (if he or she makes a difference) will affect nc electoral votes, 
the expected number of electoral votes a voter in a state of size n will affect—or the 
voter’s average power—is given by 


average power = ncP{makes a difference} 
nc 


nx /2 


= ¢/2n/1 


Thus, the average power of a voter in a state of size n is proportional to the square 
root of n, showing that, in presidential elections, voters in large states have more 
power than do those in smaller states. i 


~N 


. 
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4.6.2. Computing the Binomial Distribution Function 


Suppose that X is binomial with parameters (n, p). The key to computing its distribu- 
tion function 
i 
é n = ; 
Pix si=>°( 7 )pka — py i=0,1,...,n 
k=0 
is to utilize the following relationship between P(X = k + 1} and P{X = k}, which 
was established in the proof of Proposition 6.1: 
pn-k 


P{X =k 4 Tm = peat 


P{X =k (6.3) 


EXAMPLE 6h 


Let X be a binomial random variable with parameters n = 6,p = .4. Then, starting 
with P(X = 0} = (.6)° and recursively employing Equation (6.3), we obtain 


P{X = 0} = (.6)® = .0467 


P(X = 1) = 22 PIX = 0} © .1866 
Pix =o= 2° PIX = 1} ~ 3110 
P(X = 3) = ZSPUX = 2) © 2765 
PUX = 4) = 22 PX = 3) ~ 1382 
P(X =5) = 2=PLX = 4} ~ .0369 
P(X = 6) = 27 PX = 5} ~ .0041 a 


A computer program that utilizes the recursion (6.3) to compute the binomial 
distribution function is easily written. To compute P{X = i}, the program should 
first compute P{X = i} and then use the recursion to successively compute P{X = 
i — 1}, P{X =i — 2}, and so on. 


Historical Note 


Independent trials having a common probability of success p were first studied 
by the Swiss mathematician Jacques Bernoulli (1654-1705). In his book Ars Con- 
jectandi (The Art of Conjecturing), published by his nephew Nicholas eight years 
after his death in 1713, Bernoulli showed that if the number of such trials were 
large, then the proportion of them that were successes would be close to p with a 
probability near 1. 

Jacques Bernoulli was from the first generation of the most famous mathemat- 
ical family of all time. Altogether, there were between 8 and 12 Bernoullis, spread 
over three generations, who made fundamental contributions to probability, statis- 
tics, and mathematics. One difficulty in knowing their exact number is the fact that 
several had the same name. (For example, two of the sons of Jacques’s brother Jean 
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were named Jacques and Jean.) Another difficulty is that several of the Bernoullis 
were known by different names in different places. Our Jacques (sometimes writ- 
ten Jaques) was, for instance, also known as Jakob (sometimes written Jacob) and 
as James Bernoulli. But whatever their number, their influence and output were 
prodigious. Like the Bachs of music, the Bernoullis of mathematics were a family 
for the ages! 


EXAMPLE 6i 


If X is a binomial random variable with parameters n = 100 and p = .75, find PLX = 
70} and P{X = 70}. 


Solution. The answer is shown here in Figure 4.6. 


Binomial Distribution 


Enter Value 


Enter Value 


Enter Value 


Probability (Number of Successes i) = .04575381 


Probability (Number of Successes < = i) = .14954105 


FIGURE 4.6 


4.7 THE POISSON RANDOM VARIABLE 


A random variable X that takes on one of the values 0,1,2,... is said to be a Poisson 
random variable with parameter d if, forsome A > 0, 


ri 
p@ = P(X =i} =e*— i=0,1,2,... (7.1) 
Lt 


Equation (7.1) defines a probability mass function, since 


oo OO 44 

A et ee 
) pi) =e ) ths e=1 
i=0 i=0 


The Poisson probability distribution was introduced by Siméon Denis Poisson in a 
book he wrote regarding the application of probability theory to lawsuits, criminal 
trials, and the like. This book, published in 1837, was entitled Recherches sur la prob- 
abilité des jugements en matiére criminelle et en matiére civile (Investigations into the 
Probability of Verdicts in Criminal and Civil Matters). 

The Poisson random variable has a tremendous range of applications in diverse 
areas because it may be used as an approximation for a binomial random variable 
with parameters (n, p) when n is large and p is small enough so that np is of moderate 
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size. To see this, suppose that X is a binomial random variable with parameters (n, p), 
and let A = np. Then 


= ae py 


al ee 13 a 
~ (n — itil (<) ( *) 


nn 1) -—i +1) — Af)” 
7 ni i! (1 — A/n)i 


Now, for 1 large and A moderate, 


(1-2) =e falas a a | (1-4) 


n n' 


Hence, for n large and A moderate, 


L 

P{X = i} © ete 

In other words, if n independent trials, each of which results in a success with 
probability p, are performed, then, when n is large and p is small enough to make 
np moderate, the number of successes occurring is approximately a Poisson random 
variable with parameter 4 = np. This value 4 (which will later be shown to equal the 
expected number of successes) will usually be determined empirically. 

Some examples of random variables that generally obey the Poisson probability 
law [that is, they obey Equation (7.1)] are as follows: 


1. The number of misprints on a page (or a group of pages) of a book 

. The number of people in a community who survive to age 100 

. The number of wrong telephone numbers that are dialed in a day 

. The number of packages of dog biscuits sold in a particular store each day 

. The number of customers entering a post office on a given day 

. The number of vacancies occurring during a year in the federal judicial system 


. The number of a-particles discharged in a fixed period of time from some radioac- 
tive material 


NYDN FS WN 


Each of the preceding, and numerous other random variables, are approximately 
Poisson for the same reason—namely, because of the Poisson approximation to the 
binomial. For instance, we can suppose that there is a small probability p that each 
letter typed on a page will be misprinted. Hence, the number of misprints on a page 
will be approximately Poisson with 4 = np, where n is the number of letters on a 
page. Similarly, we can suppose that each person in a community has some small 
probability of reaching age 100. Also, each person entering a store may be thought of 
as having some small probability of buying a package of dog biscuits, and so on. 


EXAMPLE 7a 


Suppose that the number of typographical errors on a single page of this book has a 
Poisson distribution with parameter 4 = 5 Calculate the probability that there is at 
least one error on this page. 
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Solution. Letting X denote the number of errors on this page, we have 
PIX = tha = PR = OH 1 — oO & 393 = 


EXAMPLE 7b 


Suppose that the probability that an item produced by a certain machine will be 
defective is .1. Find the probability that a sample of 10 items will contain at most 
1 defective item. 


Solution. The desired probability is ce C1) Coy tae (.1)1(.9)9 = .7361, 


whereas the Poisson approximation yields the value e~! + e~! ~ .7358. | 


EXAMPLE 7c 


Consider an experiment that consists of counting the number of @ particles given 
off in a 1-second interval by 1 gram of radioactive material. If we know from past 
experience that, on the average, 3.2 such a particles are given off, what is a good 
approximation to the probability that no more than 2 a particles will appear? 


Solution. If we think of the gram of radioactive material as consisting of a large num- 
ber n of atoms, each of which has probability of 3.2/n of disintegrating and sending off 
an @ particle during the second considered, then we see that, to a very close approx- 
imation, the number of @ particles given off will be a Poisson random variable with 
parameter 4 = 3.2. Hence, the desired probability is 


227 
PIX = WSeF* 4 39e >" + eres 


& .3799 | 


Before computing the expected value and variance of the Poisson random variable 
with parameter i, recall that this random variable approximates a binomial random 
variable with parameters n and p when n is large, p is small, and 4 = np. Since such 
a binomial random variable has expected value np = i and variance np(1 — p) = 
A(1 — p) & A (since p is small), it would seem that both the expected value and the 
variance of a Poisson random variable would equal its parameter 4. We now verify 
this result: 


Sie a! 
E[X]=)- 


i=0 
COO Ay i-1 
e “x 
=i 
LG 
i=1 
5 a3 
J by lettin 
— p74 oe y g 
=he ui fat=1 
J= 


~My 
=z since ) | — =e 
j= J 
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Thus, the expected value of a Poisson random variable X is indeed equal to its 
parameter A. To determine its variance, we first compute ELX7]: 


CO >. Len* al : 
_ os Cra ue by letting 


mr J! j=i-1 


OOF aged CO 4a; 
= | jern , e u | 
=>% 7 T i 

[TF | 


where the final equality follows because the first sum is the expected value of a Pois- 
son random variable with parameter 4 and the second is the sum of the probabilities 
of this random variable. Therefore, since we have shown that E[X] = A, we obtain 


Var(X) = E[X?] — (E[X])” 
=z 


Hence, the expected value and variance of a Poisson random variable are both 
equal to its parameter A. 

We have shown that the Poisson distribution with parameter np is a very good 
approximation to the distribution of the number of successes in n independent trials 
when each trial has probability p of being a success, provided that n is large and p 
small. In fact, it remains a good approximation even when the trials are not inde- 
pendent, provided that their dependence is weak. For instance, recall the matching 
problem (Example 5m of Chapter 2) in which n men randomly select hats from a set 
consisting of one hat from each person. From the point of view of the number of men 
who select their own hat, we may regard the random selection as the result of n tri- 
als where we say that trial 7 is a success if person i selects his own hat, i = 1,...,n. 
Defining the events Fj,i=1,...,n, by 


E; = {trial i is a success} 


it is easy to see that 


P{E;} = : and P{E;|Ej} = 2. j#i 
n n—-1 

Thus, we see that, although the events £;,i = 1,...,n are not independent, their 
dependence, for large n, appears to be weak. Because of this it seems reasonable to 
expect that the number of successes will approximately have a Poisson distribution 
with parameter X 1/n = 1, and indeed this is verified in Example 5m of Chapter 2. 

For a second illustration of the strength of the Poisson approximation when the 
trials are weakly dependent, let us consider again the birthday problem presented in 
Example 5i of Chapter 2. In this example, we suppose that each of n people is equally 
likely to have any of the 365 days of the year as his or her birthday, and the problem 
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is to determine the probability that a set of n independent people all have different 
birthdays. A combinatorial argument was used to determine this probability, which 
was shown to be less than 5 when n = 23. 

We can approximate the preceding probability by using the Poisson approximation 


as follows: Imagine that we have a trial for each of the i pairs of individuals i and 
j,i # j, and say that trial i, j is a success if persons i and j have the same birthday. If 
we let Ej; denote the event that trial 7, j is a success, then, whereas the ( is ) events 


Ejj,1 =i < j =n, are not independent (see Theoretical Exercise 21), their depen- 
dence appears to be rather weak. (Indeed, these events are even pairwise indepen- 
dent, in that any 2 of the events Ej; and Ex; are independent—again, see Theoretical 
Exercise 21). Since P(Ejj) = 1/365, it is reasonable to suppose that the number of 


successes should approximately have a Poisson distribution with mean ( 3 ) / 365 = 
n(n — 1)/730. Therefore, 


P{no 2 people have the same birthday} = P{0 successes} 


—n(n — 1) 
- exp | 70 


To determine the smallest integer n for which this probability is less than - note that 


is equivalent to 


Taking logarithms of both sides, we obtain 


n(n — 1) = 730log2 
= 505.997 


which yields the solution n = 23, in agreement with the result of Example 51 of 
Chapter 2. 

Suppose now that we wanted the probability that, among the 1 people, no 3 of 
them have their birthday on the same day. Whereas this now becomes a difficult com- 
binatorial problem, it is a simple matter to obtain a good approximation. To begin, 
n 
3 
and call the i, j, k trial a success if persons i, j, and k all have their birthday on the same 
day. As before, we can then conclude that the number of successes is approximately 
a Poisson random variable with parameter 


2 
( 4 ) P{i,j,k have the same birthday} = ( 4 ) (=) 
n(n — 1)(n — 2) 


6 X (365)? 


imagine that we have a trial for each of the triplets i,j,k, where 1 Si<j<k<n, 
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Hence, 


—- —-)ham-2 
P{no 3 have the same birthday} ~ exp a Mn ) 


799350 
This probability will be less than 5 when v is such that 
n(n — 1)(n — 2) = 799350 log2 ~ 554067.1 


which is equivalent to n = 84. Thus, the approximate probability that at least 3 people 
in a group of size 84 or larger will have the same birthday exceeds 5 

For the number of events to occur to approximately have a Poisson distribution, it 
is not essential that all the events have the same probability of occurrence, but only 
that all of these probabilities be small. The following is referred to as the Poisson 
paradigm. 


Poisson Paradigm. Consider n events, with p; equal to the probability that event i 
occurs, i = 1,...,”. If all the p; are “small” and the trials are either independent or at 
most “weakly dependent,” then the number of these events that occur approximately 
has a Poisson distribution with mean )~"_, pi. 

Our next example not only makes use of the Poisson paradigm, but also illustrates 
a variety of the techniques we have studied so far. 


EXAMPLE 7d Length of the longest run 


A coin is flipped n times. Assuming that the flips are independent, with each one 
coming up heads with probability p, what is the probability that there is a string of k 
consecutive heads? 


Solution. We will first use the Poisson paradigm to approximate this probability. 
Now, if, fori =1,...,n — k + 1, we let H; denote the event that flips 7,i + 1,...,i + 
k — 1allland on heads, then the desired probability is that at least one of the events 
Hf occur. Because H; is the event that, starting with flip i, the next x flips all land on 
heads, it follows that P(H;) = pk. Thus, when p* is small, we might think that the num- 
ber of the H; that occur should have an approximate Poisson distribution. However, 
such is not the case, because, although the events all have small probabilities, some of 
their dependencies are too great for the Poisson distribution to be a good approxima- 
tion. For instance, because the conditional probability that flips 2,...,k + 1 are all 
heads given that flips 1,..., are all heads is equal to the probability that flip k + 1 
is a head, it follows that 


P(Ho|H1) = p 


which is far greater than the unconditional probability of H2. 

The trick that enables us to use a Poisson approximation is to note that there 
will be a string of k consecutive heads either if there is such a string that is imme- 
diately followed by a tail or if the final k flips all land on heads. Consequently, for 
i=1,...,n — k, let E; be the event that flips 7,...,i + k — 1 are all heads and flip 
i+ kisa tail; also, let E,_,41 be the event that flipsn — k 4+ 1,...,n are all heads. 
Note that 


P(E) =p*(1 -— p), isn—k 
P(En—41) = p* 
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Thus, when p* is small, each of the events E; has a small probability of occurring. 
Moreover, for i # j, if the events E; and E; refer to nonoverlapping sequences of flips, 
then P(E£;|E;) = P(£;); if they refer to overlapping sequences, then P(E;|E;) = 0. 
Hence, in both cases, the conditional probabilities are close to the unconditional ones, 
indicating that N, the number of the events £; that occur, should have an approximate 
Poisson distribution with mean 
n—k+1 
EIN]= >> Pi) =( — kp*d — p) + p* 

i=1 
Because there will not be a run of k heads if (and only if) N = 0, thus the preceding 
gives 


P(no head strings of length k) = P(N = 0) © exp{-—(n — k)pk( — p)- p’} 


If we let L,, denote the largest number of consecutive heads in the n flips, then, 
because L, will be less than k if (and only if) there are no head strings of length 
k, the preceding equation can be written as 


P{Ly < k} © exp{—(n — kp — p) — p*} 


Now, let us suppose that the coin being flipped is fair; that is, suppose that p = 1/2. 
Then the preceding gives 
n-—-k+2 n 
P{Ly < k} © exp {- “| = exp {ser 
k-2 
where the final approximation supposes that e2**1 ~ 1 (that is, that nat ~ 0). Let 
j = log, n, and assume that j is an integer. For k =] + i, 


n n 1 


Qk+1 ~~ DjQi+1 ~~ Di+1 


Consequently, 
P(Ln <j + i) © exp{-/2)*} 


which implies that 
P{Lyn=j+i=P{Ln <j +it+ 1} -— P{ln <j +3 
exp{—(1/2)'t7} — exp{—(1/2)'t7} 


2 


For instance, 
Pilly 27 = Stee? 3.0183 


Pily=j = 3) 2 ¢° — 2? » 1170 
Pil, =] — Mae — 2 * w 2905 
P{L,=j — xe? — 2" w 2387 
P{Ln = j} © a M4 — el? & 1723 
P{Ln =j + 1% e 8 — e 4 & 1037 
Pilg=fp+Qrewel =e ~ 0569 
Pil, =f + Bi we YY — eo we 20098 
Pil, =i +4 a1 — ¢* ~ 0308 
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Thus, we observe the rather interesting fact that no matter how large n is, the length 
of the longest run of heads in a sequence of n flips of a fair coin will be within 2 of 
log,(n) — 1 with a probability approximately equal to .86. 

We now derive an exact expression for the probability that there is a string of 
k consecutive heads when a coin that lands on heads with probability p is flipped 
n times. With the events E;,i = 1,...,n — k + 1, as defined earlier, and with L, 
denoting, as before, the length of the longest run of heads, 


P(Ly = k) = P(there is a string of k consecutive heads) = PUL Ae i) 


The inclusion—exclusion identity for the probability of a union can be written as 


n—k+1 
PU Flas 2) = a ai > P(Ei, ane Ej,) 
r=1 l<s<ly 


Let $; denote the set of flip numbers to which the event EF; refers. (So, for instance, 
S; = {1,...,k + 1}.) Now, consider one of the r-way intersection probabilities that 
does not include the event E,_x+41. That is, consider P(E;, --- Ej,) where i) < --- < 
iy <n — k +1. Onthe one hand, if there is any overlap in the sets S;,,...,.;, then this 
probability is 0. On the other hand, if there is no overlap, then the events Ej,,..., Fi, 
are independent. Therefore, 


0, if there is any overlap in S 
prea — p)'’, _ if there is no overlap 


P(E; ieee OR 


i E;,) — 
We must now determine the number of different choices of ij <---<i,<n—k+1 
for which there is no overlap in the sets S;,,...,5;,. To do so, note first that each of 
the Sj, j = 1,...,r, refer tok + 1 flips, so, without any overlap, they together refer 
to r(k + 1) flips. Now consider any permutation of r identical letters a (one for each 
of the sets S;,,...,5;,_,) and of n — r(k + 1) identical letters b (one for each of the 
trials that are not part of any of Sj,,...,5;,_,,Sn—x+1). Interpret the number of b’s 
before the first a as the number of flips before S;,, the number of b’s between the first 
and second a as the number of flips between S;, and S;,, and so on, with the number 
of b’s after the final a representing the number of flips after S;,. Because there are 
a i, *) permutations of r letters a and of n — r(k + 1) letters b, with every such 
permutation corresponding (in a one-to-one fashion) to a different nonoverlapping 
choice, it follows that 


— rk 
oD P(E;, -->E;,) = (" " ’ ma — py 


iy <-+<i,<n—k+1 
We must now consider r-way intersection probabilities of the form 


P(E, +++ Ei, En-k+1)> 


ly-1 


where iy < --- < ip_-1 <n — k + 1. Now, this probability will equal 0 if there is any 
overlap in S;,,...,5j,_,,S5,—x; if there is no overlap, then the events of the intersection 
will be independent, so 


P(E;, «+> Ei, En—xv1) = [pk — py) 1p* = pa — py} 


By asimilar argument as before, the number of nonoverlapping sets S;,,...,Si,_,,Sn—k 


will equal the number of permutations of r — 1 letters a (one for each of the sets 
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Si,,---,Si,_,) and of n (r 1)(k + 1) k =n — rk — (r — 1) letters b (one 


for each of the trials that are not part of any of S;,,...,S;,_,,Sn—x41). Since there are 
Cy permutations of r — 1 letters aand of n — rk — (r — 1) letters b, we have 


n — rk 
> Pi ++ Ei, Eni) = (" - r) P= py 


i <...<ip_j<n—k+1 


Putting it all together yields the exact expression, namely, 


oe 1| (n — rk 1/n — rk k 
Pin 2=kK= DD CY ( A yei(240) pea =p 
r=1 


where we utilize the convention that ("’) = Oifm < j. 

From a computational point of view, a more efficient method for computing the 
desired probability than the use of the preceding identity is to derive a set of recur- 
sive equations. To do so, let Ay, be the event that there is a string of k consecutive 
heads in a sequence of n flips of a fair coin, and let P, = P(A,). We will derive a 
set of recursive equations for P, by conditioning on when the first tail appears. For 
j =1,...,k, let F; be the event that the first tail appears on flip j, and let H be the 
event that the first x flips are all heads. Because the events F),..., F,, H are mutually 
exclusive and exhaustive (that is, exactly one of these events must occur), we have 


k 
P(An) = )) P(AnlFj) PUR) + P(An|H)P(A) 
j=l 


Now, given that the first tail appears on flip j, where j < k, it follows that those j 
flips are wasted as far as obtaining a string of k heads in a row; thus, the conditional 
probability of this event is the probability that such a string will occur among the 
remaining n — j flips. Therefore, 


P(An|F)) = Ph—j 
Because P(A,,|H) = 1, the preceding equation gives 
Ph= P(An) 


k 
= >> Pai PR) + PD) 
j=l 


k 
=) Pn-jpi 1 — p) + p* 


Starting with P; = 0,7 < k, and Py = p*, we can use the latter formula to recursively 
compute P;41,Px42, and so on, up to P,. For instance, suppose we want the prob- 
ability that there is a run of 2 consecutive heads when a fair coin is flipped 4 times. 
Then, with k = 2, we have P; = 0, P2 = (1 f2y. Because, when p = 1/2, the recursion 
becomes 


k 
Pr =>) Pn-j (1/2) + (1/2) 
j=l 
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we obtain 
P3 = Px(1/2) + Py(1/2)* + (1/2)* = 3/8 


and 


Pa = P3(1/2) + P2(1/2)? + (1/2)? =1/2 


which is clearly true because there are 8 outcomes that result in a string of 2 consec- 
utive heads: hhhh, hhht, hhth, hthh, thhh, hhtt, thht, and tthh. Each of these outcomes 
occurs with probability 1/16. a 


Another use of the Poisson probability distribution arises in situations where 
“events” occur at certain points in time. One example is to designate the occurrence 
of an earthquake as an event; another possibility would be for events to correspond 
to people entering a particular establishment (bank, post office, gas station, and so 
on); and a third possibility is for an event to occur whenever a war starts. Let us sup- 
pose that events are indeed occurring at certain (random) points of time, and let us 
assume that, for some positive constant A, the following assumptions hold true: 


1. The probability that exactly 1 event occurs in a given interval of length h is equal 
to Ah + o(h), where o(h) stands for any function f(h) for which pas f/h=0. 
> 


[For instance, f(h) = h? is o(h), whereas f(h) = his not.] 

2. The probability that 2 or more events occur in an interval of length h is equal 
to o(h). 

3. For any integers n, j1, j2,..., jn and any set of n nonoverlapping intervals, if we 
define E; to be the event that exactly j; of the events under consideration occur 
in the ith of these intervals, then events Fy, F2,..., E, are independent. 


Loosely put, assumptions 1 and 2 state that, for small values of h, the probability 
that exactly 1 event occurs in an interval of size h equals Ah plus something that is 
small compared with 4, whereas the probability that 2 or more events occur is small 
compared with h. Assumption 3 states that whatever occurs in one interval has no 
(probability) effect on what will occur in other, nonoverlapping intervals. 

We now show that, under assumptions 1, 2, and 3, the number of events occurring 
in any interval of length f is a Poisson random variable with parameter At. To be 
precise, let us call the interval [0, ¢] and denote the number of events occurring in that 
interval by N(f). To obtain an expression for P{N(t) = k}, we start by breaking the 
interval [0, t] into m nonoverlapping subintervals, each of length /n (Figure 4.7). 

Now, 


P{N(t) = k} = P{k of the n subintervals contain exactly 1 event 
and the other n — k contain 0 events} (7.2) 
+ P{N(t) = k and at least 1 subinterval contains 
2 or more events} 


The proceding equation holds because the event on the left side of Equation (7.2), 
that is, {N(t) = k}, is clearly equal to the union of the two mutually exclusive events 


sin qe 
= 
z 
_ 
= 
| 
eS 
VS 
=| 


FIGURE 4.7 
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on the right side of the equation. Letting A and B denote the two mutually exclusive 
events on the right side of Equation (7.2), we have 


P(B) = P{at least one subinterval contains 2 or more events} 
n 
=P |_Jtith subinterval contains 2 or more events} 
i=1 
n 
< a P{ith subinterval contains 2 or more events} 
i=1 


. t 
= ye O (<) by assumption 2 
: n 


by Boole’s 
inequality 


Now, in addition for any ¢, t/n—0 as nc, so o(t/n)/(t/n)—>0 as noo, by the defini- 
tion of o(h). Hence, 
P(B)>0 as n>c (7.3) 


Moreover, since assumptions 1 and 2 imply that? 


P{0 events occur in an interval of length h} 
=1 — [Ah + o(h) + o(h)] =1 — Ah — o(h) 


we see from the independence assumption (number 3) that 


P(A) = P{k of the subintervals contain exactly 1 event and the other 


n — k contain 0 events} 

a +\]* At r\]"“* 
=(4)[¥ +o()] [- @) - 0G) | 
n n n n 
However, since 
E (‘) Ee 
n|— +o[(- =At+t —>At aS N->oo 
n n t/n 


it follows, by the same argument that verified the Poisson approximation to the bino- 
mial, that 


Seg 
k} 


P(A)>e as Noo (7.4) 


Thus, from Equations (7.2), (7.3), and (7.4), by letting noo, we obtain 


elety® 
k! 


PIN() =k} =e k=O (7.5) 


+The sum of two functions, both of which are o(h), is also o(h). This is so because if 
limps 9 f(h)/h = limp_s 9 g(h)/h = 0, then lim, 9[f() + g(h)]/h = 0. 
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Hence, if assumptions 1, 2, and 3 are satisfied, then the number of events occurring 
in any fixed interval of length ¢ is a Poisson random variable with mean At, and we say 
that the events occur in accordance with a Poisson process having rate A. The value A, 
which can be shown to equal the rate per unit time at which events occur, is a constant 
that must be empirically determined. 

The preceding discussion explains why a Poisson random variable is usually a good 
approximation for such diverse phenomena as the following: 


1. The number of earthquakes occurring during some fixed time span 

2. The number of wars per year 

3. The number of electrons emitted from a heated cathode during a fixed time 
period 

4. The number of deaths, in a given period of time, of the policyholders of a life 
insurance company 


EXAMPLE 7e 


Suppose that earthquakes occur in the western portion of the United States in accor- 
dance with assumptions 1, 2, and 3, with 4 = 2 and with 1 week as the unit of time. 
(That is, earthquakes occur in accordance with the three assumptions at a rate of 2 
per week.) 

(a) Find the probability that at least 3 earthquakes occur during the next 2 weeks. 


(b) Find the probability distribution of the time, starting from now, until the next 
earthquake. 


Solution. (a) From Equation (7.5), we have 


P{N(2) = 3} =1 — P{N(2) = 0} — P{N(2) =1} — P{N(2) =2} 
42 


=1- 13e 
(b) Let X denote the amount of time (in weeks) until the next earthquake. Because 


X will be greater than ¢ if and only if no events occur within the next f units of time, 
we have, from Equation (7.5), 


P{X > tH} = P(N =0} =e”! 
so the probability distribution function F of the random variable X is given by 


FQ) = P(X = t}=1- P(X > H=1-e* 
—-1—e! | 


4.7.1 Computing the Poisson Distribution Function 
If X is Poisson with parameter i, then 
PUX=i+1p eAy/E+ MD A 


P(X =i} epi /i! pe 7”) 
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Starting with PLY = 0} = e~*, we can use (7.6) to compute successively 


P{X =1} =aP{xX =0} 


Px= He 5 PIX =i} 


Xd 
P{X =i + j= ——P{X =i 
1 pp A= a4 {Xx =i} 
The website includes a program that uses Equation (7.6) to compute Poisson prob- 
abilities. 
EXAMPLE 7f 


(a) Determine P{X = 90} when_X is Poisson with mean 100. 
(b) Determine P{Y = 1075} when Y is Poisson with mean 1000. 


Solution. From the website, we obtain the solutions: 
(a) P{X S 90} © 1714; 
(b) P{Y = 1075} ® .9894. a 


4.8 OTHER DISCRETE PROBABILITY DISTRIBUTIONS 
4.8.1 The Geometric Random Variable 


Suppose that independent trials, each having a probability p,0 < p < 1, of being a 
success, are performed until a success occurs. If we let X equal the number of trials 
required, then 

P{X=n}=(1— p)*'p  n=1,2,... (8.1) 


Equation (8.1) follows because, in order for X to equal n, it is necessary and sufficient 

that the first n — 1 trials are failures and the nth trial is a success. Equation (8.1) then 

follows, since the outcomes of the successive trials are assumed to be independent. 
Since 


PLY = = td - m1__ PP _4 
a n} PL p) f= a=p 


it follows that, with probability 1, a success will eventually occur. Any random vari- 
able X whose probability mass function is given by Equation (8.1) is said to be a 
geometric random variable with parameter p. 


EXAMPLE 8a 


An urn contains N white and M black balls. Balls are randomly selected, one at a 
time, until a black one is obtained. If we assume that each ball selected is replaced 
before the next one is drawn, what is the probability that 

(a) exactly n draws are needed? 

(b) at least k draws are needed? 


Solution. If we let X denote the number of draws needed to select a black ball, then 
X satisfies Equation (8.1) with p = M/(M + N). Hence, 
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(a) 


N \"' M  _ MNv1 
M+N (M+4+N)" 


(b) 


M oo n—-1 
PIX =ky= 3 au 
M+N2\M+N 


-(rtn) 


Of course, part (b) could have been obtained directly, since the probability that at 
least k trials are necessary to obtain a success is equal to the probability that the first 
k — 1 trials are all failures. That is, for a geometric random variable, 


P{X = ky=(1 — p)*t 


EXAMPLE 8b 


Find the expected value of a geometric random variable. 


Solution. With q = 1 — p, we have 
oe . 
E[X] =) igh 'p 
i=l 


ms . 
=S°G-14+1¢q''p 
i=1 


(oe) CO 
=) ¢- Dep + >a? 
i=1 i=1 
oe) 
=>igp +1 
j=0 


[o-e) 
=q) iq 'p +1 
ja 
= gE[X] +1 


Hence, 


yielding the result 
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In other words, if independent trials having a common probability p of being success- 
ful are performed until the first success occurs, then the expected number of required 
trials equals 1/p. For instance, the expected number of rolls of a fair die that it takes 
to obtain the value 1 is 6. a 


EXAMPLE 8c 


Find the variance of a geometric random variable. 


Solution. To determine Var(X), let us first compute ELX7]. With g = 1 — p, we have 


=D 1+ ia 
Se . a . 
=>°@- 1)°¢q'"p + 2 —1qi'p + Yod'p 
i=1 i=1 i=1 


[o-e) 
=) 7dip + 25 ig +1 
J=0 j=1 

= gE[X*] + 2qgE[X] + 1 


Using E[X] = 1/p, the equation for ELX7] yields 


2 
pELX?]= 1 +1 
P 
Hence, 
2G Pp . gl 
2 
E[X*] a | 
P P 
giving the result 
1 1 1- 
Var(X) = gr = P 


Pp Pp P a 
4.8.2 The Negative Binomial Random Variable 


Suppose that independent trials, each having probability p,0 < p < 1, of being a 
success are performed until a total of r successes is accumulated. If we let XY equal the 
number of trials required, then 


Pix=np=("~ fp = py n=rrt+1,... (8.2) 


Equation (8.2) follows because, in order for the rth success to occur at the nth trial, 
there must be r — 1 successes in the first n — 1 trials and the nth trial must be a 
success. The probability of the first event is 


=i r— n—-r 
te )p cal = p) 
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and the probability of the second is p; thus, by independence, Equation (8.2) is estab- 
lished. To verify that a total of r successes must eventually be accumulated, either we 
can prove analytically that 


(oe) CO em 1 
Yrxany= (7 1 era — py" =1 (8.3) 
n=r n=r 
or we can give a probabilistic argument as follows: The number of trials required 
to obtain r successes can be expressed as Yj + Y2 + --- + Y;, where Y; equals 


the number of trials required for the first success, Y2 the number of additional trials 

after the first success until the second success occurs, Y3 the number of additional 

trials until the third success, and so on. Because the trials are independent and all 

have the same probability of success, it follows that Y;, Y2,..., Y; are all geometric 
r 


random variables. Hence, each is finite with probability 1,so )° Y; must also be finite, 
i=1 

establishing Equation (8.3). 

Any random variable X whose probability mass function is given by Equation (8.2) 
is said to be a negative binomial random variable with parameters (r, p). Note that a 
geometric random variable is just a negative binomial with parameter (1, p). 

In the next example, we use the negative binomial to obtain another solution of 
the problem of the points. 


EXAMPLE 8d 


If independent trials, each resulting in a success with probability p, are performed, 
what is the probability of r successes occurring before m failures? 


Solution. The solution will be arrived at by noting that r successes will occur before 
m failures if and only if the rth success occurs no later than the (r + m — 1)th 
trial. This follows because if the rth success occurs before or at the (r + m — 1)th 
trial, then it must have occurred before the mth failure, and conversely. Hence, from 
Equation (8.2), the desired probability is 


r+m-1 hat 
y (7 >} )era- pr r 


n=r 
EXAMPLE 8e The Banach match problem 


At all times, a pipe-smoking mathematician carries 2 matchboxes—1 in his left-hand 
pocket and 1 in his right-hand pocket. Each time he needs a match, he is equally likely 
to take it from either pocket. Consider the moment when the mathematician first 
discovers that one of his matchboxes is empty. If it is assumed that both matchboxes 
initially contained N matches, what is the probability that there are exactly k matches, 
k =0,1,...,N, in the other box? 


Solution. Let E denote the event that the mathematician first discovers that the right- 
hand matchbox is empty and that there are k matches in the left-hand box at the 
time. Now, this event will occur if and only if the (NV + 1)th choice of the right-hand 
matchbox is made at the (VN + 1 + N — k)th trial. Hence, from Equation (8.2) (with 
p= sr=N + l,andn=2N — k + 1), wesee that 


= 1 2N—k+1 
no-(™5 NC) 
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Since there is an equal probability that it is the left-hand box that is first discovered 
to be empty and there are k matches in the right-hand box at that time, the desired 


result is 
Nk 1\2N-k 
no=("5*) (2) : 
EXAMPLE 8f 


Compute the expected value and the variance of a negative binomial random variable 
with parameters r and p. 


Solution. We have 


E[X*] = Don‘ & _ | era py 


n=r 
PS 1 
=F yn t() pia — py since n(M-t)=r(7) 
pS r r— r 
0° - by setting 
- >> (m - 1)" (” r ") pra — py") mont 
m=r+1 


r 


= -E((Y — 1)*"] 
P 


where Y is a negative binomial random variable with parameters r + 1,p. Setting 
k = 1 in the preceding equation yields 


Setting k = 2 in the equation for ELX*] and using the formula for the expected value 
of a negative binomial random variable gives 


E[X?] = Say ij 


Therefore, 


p? a 


Thus, from Example 8f, if independent trials, each of which is a success with prob- 
ability p, are performed, then the expected value and variance of the number of trials 
that it takes to amass r successes is r/p and r(1 — p)/p*, respectively. 

Since a geometric random variable is just a negative binomial with parameter 
r =1, it follows from the preceding example that the variance of a geometric ran- 
dom variable with parameter p is equal to (1 — p)/p”, which checks with the result 
of Example 8c. 
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EXAMPLE 8g 


Find the expected value and the variance of the number of times one must throw a 
die until the outcome 1 has occurred 4 times. 


Solution. Since the random variable of interest is a negative binomial with parame- 
tersr=4andp = 7 it follows that 


E[X] =24 


Var(X) = 120 


4.8.3. The Hypergeometric Random Variable 


Suppose that a sample of size n is to be chosen randomly (without replacement) from 
an urn containing N balls, of which m are white and N — mare black. If we let X 
denote the number of white balls selected, then 


peer cele, i= 0,1,...,7 (8.4) 
(7) 


A random variable X whose probability mass function is given by Equation (8.4) for 
some values of n, N, m is said to be a hypergeometric random variable. 


Remark. Although we have written the hypergeometric probability mass func- 
tion with 7 going from 0 ton, P{X = 7} will actually be 0, unless i satisfies the inequali- 
tiesn — (N — m) Si S min(n,m). However, Equation (8.4) is always valid because 


of our convention that : is equal to 0 when either k < Oorr < k. a 


EXAMPLE 8h 

An unknown number, say, N, of animals inhabit a certain region. To obtain some 
information about the size of the population, ecologists often perform the follow- 
ing experiment: They first catch a number, say, m, of these animals, mark them in 
some manner, and release them. After allowing the marked animals time to disperse 
throughout the region, a new catch of size, say, n, is made. Let X denote the number 
of marked animals in this second capture. If we assume that the population of ani- 
mals in the region remained fixed between the time of the two catches and that each 
time an animal was caught it was equally likely to be any of the remaining uncaught 
animals, it follows that _X is a hypergeometric random variable such that 


@lems 

1 n—-i 

PIX =i}= (*) = Pi(N) 
n 


Suppose now that X is observed to equal i. Then, since P;(N) represents the proba- 
bility of the observed event when there are actually N animals present in the region, it 
would appear that a reasonable estimate of N would be the value of N that maximizes 
P(N). Such an estimate is called a maximum likelihood estimate. (See Theoretical 
Exercises 13 and 18 for other examples of this type of estimation procedure.) 
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The maximization of P;(N) can be done most simply by first noting that 


P(N)  W-mW-7” 
PAN — 1)” NIN —m—-—n + dD 


Now, the preceding ratio is greater than 1 if and only if 
(N — m)(N — n) = NWN —-m—1n +1) 


or, equivalently, if and only if 
Nz = 
i 

Thus, P;(N) is first increasing and then decreasing, and reaches its maximum value 
at the largest integral value not exceeding mn/i. This value is the maximum likeli- 
hood estimate of N. For example, suppose that the initial catch consisted of m = 
50 animals, which are marked and then released. If a subsequent catch consists of 
n = 40 animals of which i = 4 are marked, then we would estimate that there are 
some 500 animals in the region. (Note that the preceding estimate could also have 
been obtained by assuming that the proportion of marked animals in the region, 
m/N, is approximately equal to the proportion of marked animals in our second 
catch, i/n.) | 


EXAMPLE 8i 


A purchaser of electrical components buys them in lots of size 10. It is his policy 
to inspect 3 components randomly from a lot and to accept the lot only if all 3 are 
nondefective. If 30 percent of the lots have 4 defective components and 70 percent 
have only 1, what proportion of lots does the purchaser reject? 


Solution. Let A denote the event that the purchaser accepts a lot. Now, 


3 
P(A) = P(A|lot has 4 defectives) 5 + P(A|lot has 1 defective) 
4 6 1 9 
0 3 3 : 0 3 7 
~ 10 (33) | 10 (=) 
3 3 


54 
Hence, 46 percent of the lots are rejected. | 


~ 700 


If n balls are randomly chosen without replacement from a set of N balls of which 
the fraction p = m/N is white, then the number of white balls selected is hypergeo- 
metric. Now, it would seem that when m and N are large in relation to n, it shouldn’t 
make much difference whether the selection is being done with or without replace- 
ment, because, no matter which balls have previously been selected, when m and N 
are large, each additional selection will be white with a probability approximately 
equal to p. In other words, it seems intuitive that when m and N are large in relation 
to n, the probability mass function of X should approximately be that of a binomial 
random variable with parameters n and p. To verify this intuition, note that if X is 
hypergeometric, then, fori = n, 
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= m! (N — m)! (N — n)!n! 
~~ (m—-plil(N-m—n+d)!n—)D! N! 
=(1) RS m—-it1i1N-—-mN-m-—1 


iJNN=1 Nh I NSE N STH 1 
N-m (n —i-— 1) 
Na=i=@-i-D 
es _ When p = m/N and mand N are 
~ ( F )r'a — py" large in relation to n andi 


EXAMPLE 8j 


Determine the expected value and the variance of X, a hypergeometric random vari- 
able with parameters n, N, and m. 


Solution. 


Ax T=> rsa 


ye) 


Using the identities 


aye mesma) (Nom) [(¥ 1) 


II 
& 
| rm 
— 
x 
| 
T 
ray 
WY 
T 
rary 
—s 


where Y is a hypergeometric random variable with parameters n — 1, N — 1, and 
m — 1. Hence, upon setting k = 1, we have 


BX] = => 


In words, if n balls are randomly selected from a set of N balls, of which m are white, 
then the expected number of white balls selected is nm/N. 
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Upon setting k = 2 in the equation for E[X*], we obtain 


E[X?] = —CELY + 1] 
_ nm |[(n — 1)\(m — 1) aa 
=F Nat | 


where the final equality uses our preceding result to compute the expected value of 
the hypergeometric random variable Y. 
Because E[X] = nm/N, we can conclude that 


—1 —1 
tat CE DO ND 45 
N N-1 N 
Letting p = m/N and using the identity 
ma. Np 1 1-—p 
N-1 N-1 ? N-1 
shows that 
Lp 
Var(X) = np[(n — 1)p — (n EG 7d 1 — np] 
n—-1 
=np(1 — p)(l ) 
N-1 Py 


Remark. We have shown in Example §j that if balls are randomly selected with- 
out replacement from a set of N balls, of which the fraction p are white, then the 
expected number of white balls chosen is np. In addition, if N is large in relation to n 
[so that (NV — n)/(N — 1) is approximately equal to 1], then 


Var(X) © np(1 — p) 


In other words, E[X] is the same as when the selection of the balls is done with 
replacement (so that the number of white balls is binomial with parameters n 
and p), and if the total collection of balls is large, then Var(X) is approximately equal 
to what it would be if the selection were done with replacement. This is, of course, 
exactly what we would have guessed, given our earlier result that when the number 
of balls in the urn is large, the number of white balls chosen approximately has the 
mass function of a binomial random variable. a 


4.8.4 The Zeta (or Zipf) Distribution 


A random variable is said to have a zeta (sometimes called the Zipf) distribution if 
its probability mass function is given by 


c 


ley arene 


for some value of a > 0. Since the sum of the foregoing probabilities must equal 1, it 
follows that 
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The zeta distribution owes its name to the fact that the function 


wate) e() 2) 


is known in mathematical disciplines as the Riemann zeta function (after the German 
mathematician G. F. B. Riemann). 

The zeta distribution was used by the Italian economist V. Pareto to describe the 
distribution of family incomes in a given country. However, it was G. K. Zipf who 
applied zeta distribution to a wide variety of problems in different areas and, in doing 
so, popularized its use. 


4.9 EXPECTED VALUE OF SUMS OF RANDOM VARIABLES 


A very important property of expectations is that the expected value of a sum of 
random variables is equal to the sum of their expectations. In this section, we will 
prove this result under the assumption that the set of possible values of the proba- 
bility experiment—that is, the sample space S—is either finite or countably infinite. 
Although the result is true without this assumption (and a proof is outlined in the 
theoretical exercises), not only will the assumption simplify the argument, but it will 
also result in an enlightening proof that will add to our intuition about expectations. 
So, for the remainder of this section, suppose that the sample space S is either a finite 
or a countably infinite set. 

For a random variable _X, let_X(s) denote the value of X whens € S is the outcome 
of the experiment. Now, if X and Y are both random variables, then so is their sum. 
That is, Z= X + Y isalsoarandom variable. Moreover, Z(s) = X(s) + Y(s). 


EXAMPLE 9a 


Suppose that the experiment consists of flipping a coin 5 times, with the outcome 
being the resulting sequence of heads and tails. Suppose X is the number of heads in 
the first 3 flips and Y is the number of heads in the final 2 flips. Let Z = X + Y. Then, 
for instance, for the outcome s = (h,t,h,t,h), 


X(s) =2 
Y(s) =1 
Z(s) = X(s) + Y(s) =3 


meaning that the outcome (A, t,h,t,h) results in 2 heads in the first three flips, 1 head 
in the final two flips, and a total of 3 heads in the five flips. a 


Let p(s) = P({s}) be the probability that s is the outcome of the experiment. 
Because we can write any event A as the finite or countably infinite union of the 
mutually exclusive events {s},s € A, it follows by the axioms of probability that 


P(A) = Dos) 
seA 
When A = S, the preceding equation gives 


1= >" p@) 


seS 
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Now, let X be a random variable, and consider E[X]. Because X(s) is the value of X 
when s is the outcome of the experiment, it seems intuitive that ELX ]|—the weighted 
average of the possible values of X, with each value weighted by the probability that 
X assumes that value—should equal a weighted average of the values X(s),s € S, 
with X(s) weighted by the probability that s is the outcome of the experiment. We 
now prove this intuition. 

Proposition 9.1. 

E[X] =} X(s) p) 


seS 


Proof. Suppose that the distinct values of X are x;,i = 1. For each i, let S; be the 
event that X is equal to x;. That is, 8; = {s : X(s) = x;}. Then, 


Bx| => xPix Sx} 
=) xP(S) 
=>) a> po) 


ses; 


=>) > 8) 


i seS; 
=>) Xp) 
i ses; 
= >> X(s)p(s) 
seS 


where the final equality follows because $;,5S2,... are mutually exclusive events 
whose union is S. 


EXAMPLE 9b 


Suppose that two independent flips of a coin that comes up heads with probability p 
are made, and let _X denote the number of heads obtained. Because 


P(X =0) = P(t,) = (1 — p)’, 
P(X =1) = Pth,t) + P(t,h) = 2p — p) 
P(X = 2) = P(h,h) = p* 


it follows from the definition of expected value that 

E[X]=0- (1 — p)? +1- 2p. - p) + 2- p?=2p 
which agrees with 
E[X] = X(h,hyp? + X(h,Op — p) + XA) — p)p + XW,00 — py 


= 2p? + pd — p) + 1 — pip 
= 2p a 


We now prove the important and useful result that the expected value of a sum of 
random variables is equal to the sum of their expectations. 
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Corollary 9.2. For random variables X;, X2,...,Xn, 


n n 
E|>°% |=) EX 
i=1 i=1 
Proof. Let Z = >~_, Xi. Then, by Proposition 9.1, 


E[Z] = D> Z(s)p(s) 


seS 
=) (Xs) + X2(s) +... + Xn(s)) pO) 
seS 
= S>X()p(s) + D5 X2(s)ps) + -.. + YO Xn() ps) 
ses seS ses 
= E[X1] + E[X2] + ... + ELXn] | 


EXAMPLE 9c 


Find the expected value of the sum obtained when n fair dice are rolled. 


Solution. Let X be the sum. We will compute ELX] by using the representation 


X= WX 
i=1 


where X; is the upturned value on die 7. Because Xj; is equally likely to be any of the 
values from 1 to 6, it follows that 


6 
EA\= ¥ ile) =2176= 7/2 


i=1 


which yields the result 
n n 
AXJ=E) YG |= >, BX =3.5n 
i=1 i=l 


EXAMPLE 9d 


Find the expected total number of successes that result from n trials when trial 7 is a 
success with probability pj, i=1,...,n. 


Solution. Letting 


1, if trial 7 is a success 
xe (h 


0, if trial iis a failure 


we have the representation 
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Consequently, 
n n 
E[X] = )) ELXi] = Di 
i=1 i=1 


Note that this result does not require that the trials be independent. It includes as a 
special case the expected value of a binomial random variable, which assumes inde- 
pendent trials and all p; = p, and thus has mean np. It also gives the expected value 
of a hypergeometric random variable representing the number of white balls selected 
when n balls are randomly selected, without replacement, from an urn of N balls of 
which m are white. We can interpret the hypergeometric as representing the number 
of successes in 7 trials, where trial i is said to be a success if the ith ball selected is 
white. Because the ith ball selected is equally likely to be any of the N balls and thus 
has probability m/N of being white, it follows that the hypergeometric is the num- 
ber of successes in 7 trials in which each trial is a success with probability p = m/N. 
Hence, even though these hypergeometric trials are dependent, it follows from the 
result of Example 9d that the expected value of the hypergeometric is np = nm/N.@ 


EXAMPLE 9e 


Derive an expression for the variance of the number of successful trials in Example 
9d, and apply it to obtain the variance of a binomial random variable with parameters 
nand p, and of a hypergeometric random variable equal to the number of white balls 
chosen when n balls are randomly chosen from an urn containing N balls of which m 
are white. 


Solution. Letting X be the number of successful trials, and using the same represen- 
tation for ¥—namely, X = )~_, X;—as in the previous example, we have 


i=1 jai 
=E oe + Sy ee 
oT 
= a + BX, 
i=1 jAi 
D+ VY axe (9.1) 
i=l jAi 


where the final equation used that X; ? — X;. However, because the possible values of 
both _X; and_X; are 0 or 1, it follows that 


1, ifX;=1,X)=1 


AGS | 0, otherwise 
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Hence, 
E[X;Xj] = P{X; = 1, Xj = 1} = P(trials i and j are successes) 


Now, on the one hand, if X is binomial, then, for i # j, the results of trial i and trial j 
are independent, with each being a success with probability p. Therefore, 


E[X;Xj)=p*, iFj 


Together with Equation (9.1), the preceding equation shows that, for a binomial ran- 
dom variable X, 
E[X?] = np + n(n — 1)p? 


implying that 


Var(X) = E[X?] — (E[X])* = np + n(n — 1)p? — n’*p*? = np — p) 


On the other hand, if X is hypergeometric, then, given that a white ball is chosen 
in trial 7, each of the other N — 1 balls, of which m — 1 are white, is equally likely to 
be the jth ball chosen, for j # i. Consequently, for j # i, 


mm — 1 
NN-1 


PH a a= POG Se HSS 


Using p; = m/N, we now obtain, from Equation (9.1), 


EX] = n(n — 1) 


Consequently, 


nm mm-—1 nm\? 
Var(X) = = + n(n DG NOT ( ) 


which, as shown in Example 8j, can be simplified to yield 
n-1 
Var(X) =np(1 — 1 — —— 
ar(X) = np(1 — p) ( No ") 
where p = m/N. | 


4.10 PROPERTIES OF THE CUMULATIVE DISTRIBUTION FUNCTION 


Recall that, for the distribution function F of X, F(b) denotes the probability that the 
random variable X takes on a value that is less than or equal to b. Following are some 
properties of the cumulative distribution function (c.d.f.) F: 
1. Fis a nondecreasing function; that is, ifa < b, then F(a) = F(b). 
2. lim F(b) =1. 
b> co 
3. lim F(b)=0. 
b—>—oco 


4. F is right continuous. That is, for any b and any decreasing sequence by,,n = 1, 
that converges to b, lim F(b,) = F(b). 
n (oe) 


Property 1 follows, as was noted in Section 4.1, because, for a < b, the event 
{X =< a} is contained in the event {X = b} and so cannot have a larger probabil- 
ity. Properties 2, 3, and 4 all follow from the continuity property of probabilities 
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(Section 2.6). For instance, to prove property 2, we note that if b, increases to co, then 
the events {X = b,},n = 1, are increasing events whose union is the event {X < ov}. 
Hence, by the continuity property of probabilities, 


lim P{X < b,} = P(X < of =1 
no 


which proves property 2. 

The proof of property 3 is similar and is left as an exercise. To prove property 4, 
we note that if b, decreases to b, then {X¥ = by},n = 1, are decreasing events whose 
intersection is {X = b}. The continuity property then, yields 


lim P{X = by} = P{X = 5} 


which verifies property 4. 


All probability questions about X can be answered in terms of the c.d.f., F. For 
example, 


Pla < X = b}=F(b) — F(a) foralla < b (8.1) 


This equation can best be seen to hold if we write the event {X = b} as the union of 
the mutually exclusive events {X =< a} and {a < X = b}. That is, 

{X = b}={X =a} U {a < X = 5} 
sO 


P(X <b} =P(X <a} + Pla< X <}d} 


which establishes Equation (9.1). 
If we want to compute the probability that X is strictly less than b, we can again 
apply the continuity property to obtain 


= lim P(x sb - -) 
nN 
= lim F( — -) 
noo n 


Note that P{X < b} does not necessarily equal F(b), since F(b) also includes the 
probability that X equals b. 


EXAMPLE 10a 


The distribution function of the random variable X is given by 


0) x < 0 
; 02% 21 
2 

F(x) = 3 L=ex<22 
11 
1 35x 
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FIGURE 4.8: Graph of F(x). 


A graph of F(x) is presented in Figure 4.8. Compute (a) P{X < 3}, (b) P{X = 1}, (c) 
P{X > 5}, and (d) P{2 < X < 4}. 


Solution. (a) P{X < 3) = tim P | x =3- - =lim F (3 _— -) => 
(b) 
PIX = =P(X <1 - PIX <3 
. 1 2 1 1 
=F(1) - tim F (1 ~)=3 a: 
(c) 
P{X > f= -P{xs3 
1 3 
= FG)=] 
(d) 
P22 < X <4}=F(4) — F(2) 
il 
~ 12 a 
SUMMARY 


A real-valued function defined on the outcome of a probability experiment is called 
a random variable. 
If X is a random variable, then the function F(x) defined by 


F(x) = P{X = x} 


is called the distribution function of X. All probabilities concerning X can be stated 
in terms of F. 
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A random variable whose set of possible values is either finite or countably infinite 
is called discrete. If X is a discrete random variable, then the function 


p(x) = P{X = x} 
is called the probability mass function of X. Also, the quantity E[X] defined by 
E[X]= >) xp) 


xip(x)>0 


is called the expected value of X. E[X] is also commonly called the mean or the expec- 
tation of X. 
A useful identity states that, for a function g, 


Elg(X)]= SY) g@pom 
xip(x)>0 
The variance of a random variable X, denoted by Var(X), is defined by 
Var(X) = E[(X — E[X])’] 


The variance, which is equal to the expected square of the difference between X 
and its expected value, is a measure of the spread of the possible values of X. A useful 
identity is 

Var(X) = E[X*] — (E[X])* 
The quantity ./ Var(X) is called the standard deviation of X. 


We now note some common types of discrete random variables. The random vari- 
able X whose probability mass function is given by 


pti) = (7 )e'a — py" i=0,...,n 


is said to be a binomial random variable with parameters n and p. Such a random 
variable can be interpreted as being the number of successes that occur when n inde- 
pendent trials, each of which results in a success with probability p, are performed. 
Its mean and variance are given by 


E[|X|]=np Var(X) =np(1 — p) 
The random variable X whose probability mass function is given by 
—Ayi 


e ? 
i=0 


PO=—, 
lL. 


is said to be a Poisson random variable with parameter i. If a large number of (approx- 
imately) independent trials are performed, each having a small probability of being 
successful, then the number of successful trials that result will have a distribution 
which is approximately that of a Poisson random variable. The mean and variance of 
a Poisson random variable are both equal to its parameter 4. That is, 


E[|X] = Var(X) =A 
The random variable X whose probability mass function is given by 


p@=pd — py! i=1,2,... 
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4.1. Two balls are chosen randomly from an urn con- 


Random Variables 


is said to be a geometric random variable with parameter p. Such a random variable 
represents the trial number of the first success when each trial is independently a 
success with probability p. Its mean and variance are given by 


i= p 
p2 


E[X]= - Var(X) = 


The random variable X whose probability mass function is given by 
: i-1\, jp 3 
po=(— 5 era =») L=7 


is said to be a negative binomial random variable with parameters r and p. Such a 
random variable represents the trial number of the rth success when each trial is 
independently a success with probability p. Its mean and variance are given by 


E[X]=~ Var(X) = cee 
p P 


A hypergeometric random variable X with parameters n, N, and m represents the 
number of white balls selected when n balls are randomly chosen from an urn that 
contains N balls of which m are white. The probability mass function of this random 
variable is given by 


p= 


With p = m/N, its mean and variance are 


= TL 
ppd =p) 


E[X]=np Var(X) = ~ 


An important property of the expected value is that the expected value of a sum of 
random variables is equal to the sum of their expected values. That is, 


n it 
E|> > % |=) EL 
i=1 i=1 


PROBLEMS 


4.3. Three dice are rolled. By assuming that each of 


4.2. 


taining 8 white, 4 black, and 2 orange balls. Sup- 
pose that we win $2 for each black ball selected 
and we lose $1 for each white ball selected. Let 
X denote our winnings. What are the possible val- 
ues of X, and what are the probabilities associated 
with each value? 

Two fair dice are rolled. Let X equal the 
product of the 2 dice. Compute P{X = i} for 
P= 1, 2.6336. 


the 6? = 216 possible outcomes is equally likely, 
find the probabilities attached to the possible val- 
ues that XY can take on, where X is the sum of 
the 3 dice. 


4.4. Five men and 5 women are ranked according to 


their scores on an examination. Assume that no 
two scores are alike and all 10! possible rankings 
are equally likely. Let X denote the highest rank- 
ing achieved by a woman. (For instance, X¥ = 1 


4.5. 


4.6. 


4.7. 


4.8. 


4.9. 


4.10. 


4.11. 


4.12. 


if the top-ranked person is female.) Find P{X = i}, 
be 2. Beas. Ox G10, 
Let X represent the difference between the num- 
ber of heads and the number of tails obtained 
when a coin is tossed n times. What are the pos- 
sible values of X? 
In Problem 5, for n = 3, if the coin is assumed fair, 
what are the probabilities associated with the val- 
ues that _X can take on? 
Suppose that a die is rolled twice. What are the 
possible values that the following random vari- 
ables can take on: 
(a) the maximum value to appear in the two rolls; 
(b) the minimum value to appear in the two rolls; 
(c) the sum of the two rolls; 
(d) the value of the first roll minus the value of 
the second roll? 
If the die in Problem 7 is assumed fair, calculate 
the probabilities associated with the random vari- 
ables in parts (a) through (d). 
Repeat Example 1b when the balls are selected 
with replacement. 
In Example 1d, compute the conditional probabil- 
ity that we win i dollars, given that we win some- 
thing; compute it for 7 = 1,2,3. 
(a) An integer N is to be selected at random from 
{1,2,...,(10)7} in the sense that each integer 
has the same probability of being selected. 
What is the probability that N will be divis- 
ible by 3? by 5? by 7? by 15? by 105? How 
would your answer change if (10)* is replaced 
by (10)* as k became larger and larger? 
An important function in number theory— 
one whose properties can be shown to be 
related to what is probably the most impor- 
tant unsolved problem of mathematics, the 
Riemann hypothesis—is the Mo6bius function 
i(n), defined for all positive integral values n 
as follows: Factor n into its prime factors. If 
there is a repeated prime factor, as in 12 = 
2-2-+-30r49 =7 - 7, then p(n) is defined 
to equal 0. Now let N be chosen at random 
from {1,2,... (10)*}, where k is large. Deter- 
mine P{u(N) = 0} as k—oo. 
Hint: To compute P{j(N) # 0}, use the identity 


i7s*=(2)(8)2)(8)-=4 


where P; is the ith-smallest prime. (The number 1 
is not a prime.) 

In the game of Two-Finger Morra, 2 players show 
1 or 2 fingers and simultaneously guess the number 
of fingers their opponent will show. If only one of 
the players guesses correctly, he wins an amount 


(b) 


4.13. 


4.14. 


4.15. 
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(in dollars) equal to the sum of the fingers shown 
by him and his opponent. If both players guess 
correctly or if neither guesses correctly, then no 
money is exchanged. Consider a specified player, 
and denote by X the amount of money he wins in 
a single game of Two-Finger Morra. 

(a) Ifeach player acts independently of the other, 
and if each player makes his choice of the 
number of fingers he will hold up and the 
number he will guess that his opponent will 
hold up in such a way that each of the 4 pos- 
sibilities is equally likely, what are the possi- 
ble values of X and what are their associated 
probabilities? 

Suppose that each player acts independently 
of the other. If each player decides to hold up 
the same number of fingers that he guesses his 
opponent will hold up, and if each player is 
equally likely to hold up 1 or 2 fingers, what 
are the possible values of X and their associ- 
ated probabilities? 


(b) 


A salesman has scheduled two appointments to 
sell encyclopedias. His first appointment will lead 
to a sale with probability .3, and his second will 
lead independently to a sale with probability .6. 
Any sale made is equally likely to be either for the 
deluxe model, which costs $1000, or the standard 
model, which costs $500. Determine the probabil- 
ity mass function of X, the total dollar value of all 
sales. 


Five distinct numbers are randomly distributed 
to players numbered 1 through 5. Whenever two 
players compare their numbers, the one with the 
higher one is declared the winner. Initially, players 
1 and 2 compare their numbers; the winner then 
compares her number with that of player 3, and so 
on. Let X denote the number of times player 1 is a 
winner. Find PLX = i},i = 0,1,2,3,4. 


The National Basketball Association (NBA) draft 
lottery involves the 11 teams that had the worst 
won-lost records during the year. A total of 66 
balls are placed in an urn. Each of these balls is 
inscribed with the name of a team: Eleven have 
the name of the team with the worst record, 10 
have the name of the team with the second-worst 
record, 9 have the name of the team with the third- 
worst record, and so on (with 1 ball having the 
name of the team with the 11th-worst record). 
A ball is then chosen at random, and the team 
whose name is on the ball is given the first pick 
in the draft of players about to enter the league. 
Another ball is then chosen, and if it “belongs” 
to a team different from the one that received the 
first draft pick, then the team to which it belongs 
receives the second draft pick. (If the ball belongs 
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to the team receiving the first pick, then it is dis- 
carded and another one is chosen; this continues 
until the ball of another team is chosen.) Finally, 
another ball is chosen, and the team named on 
the ball (provided that it is different from the 
previous two teams) receives the third draft pick. 
The remaining draft picks 4 through 11 are then 
awarded to the 8 teams that did not “win the lot- 
tery,” in inverse order of their won-lost records. 
For instance, if the team with the worst record did 
not receive any of the 3 lottery picks, then that 
team would receive the fourth draft pick. Let X 
denote the draft pick of the team with the worst 
record. Find the probability mass function of X. 
In Problem 15, let team number 1 be the team 
with the worst record, let team number 2 be the 
team with the second-worst record, and so on. Let 
Y; denote the team that gets draft pick number i. 
(Thus, Y; = 3 if the first ball chosen belongs to 
team number 3.) Find the probability mass func- 
tion of (a) Y1, (b) Y2, and (c) Y3. 

Suppose that the distribution function of X is 
given by 


0 b <0 

b 

1 b-1 

11 

—= 2=b<3 

2 * 
3=b 


(a) Find P{X = i},i= 1,2,3. 

(b) Find P{5 < X < 3}. 

Four independent flips of a fair coin are made. Let 
X denote the number of heads obtained. Plot the 
probability mass function of the random variable 
X — 2. 

If the distribution function of X is given by 


b <0 
Osb<1 
1sb<2 


2<=b<3 


A 


3b <35 
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b= 3.5 


calculate the probability mass function of X. 
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A gambling book recommends the following “win- 
ning strategy” for the game of roulette: Bet $1 on 
red. If red appears (which has probability #8), then 
take the $1 profit and quit. If red does not appear 
and you lose this bet (which has probability a of 
occurring), make additional $1 bets on red on each 
of the next two spins of the roulette wheel and then 
quit. Let X denote your winnings when you quit. 
(a) Find P{X > O}. 
(b) Are you convinced that the strategy is indeed 
a “winning” strategy? Explain your answer! 
(c) Find ELX]. 
Four buses carrying 148 students from the same 
school arrive at a football stadium. The buses 
carry, respectively, 40, 33, 25, and 50 students. One 
of the students is randomly selected. Let XY denote 
the number of students that were on the bus car- 
rying the randomly selected student. One of the 4 
bus drivers is also randomly selected. Let Y denote 
the number of students on her bus. 
(a) Which of ELX] or E[Y] do you think is larger? 
Why? 
(b) Compute E[X] and E[Y]. 
Suppose that two teams play a series of games that 
ends when one of them has won i games. Suppose 
that each game played is, independently, won by 
team A with probability p. Find the expected num- 
ber of games that are played when (a) i = 2 and (b) 
i = 3. Also, show in both cases that this number is 
maximized when p = 5. 
You have $1000, and a certain commodity 
presently sells for $2 per ounce. Suppose that after 
one week the commodity will sell for either $1 
or $4 an ounce, with these two possibilities being 
equally likely. 
(a) If your objective is to maximize the expected 
amount of money that you possess at the 
end of the week, what strategy should you 
employ? 
If your objective is to maximize the expected 
amount of the commodity that you possess at 
the end of the week, what strategy should you 
employ? 
A and B play the following game: A writes down 
either number 1 or number 2, and B must guess 
which one. If the number that A has written down 
is i and B has guessed correctly, B receives 7 units 
from A. If B makes a wrong guess, B pays ; unit to 
A. If B randomizes his decision by guessing 1 with 
probability p and 2 with probability 1 — p, deter- 
mine his expected gain if (a) A has written down 
number 1 and (b) A has written down number 2. 
What value of p maximizes the minimum pos- 
sible value of B’s expected gain, and what is 
this maximin value? (Note that B’s expected 
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gain depends not only on p, but also on what 

A does.) 

Consider now player A. Suppose that she also 
randomizes her decision, writing down number 1 
with probability g. What is A’s expected loss if (c) 
B chooses number 1 and (d) B chooses number 2? 

What value of g minimizes A’s maximum 
expected loss? Show that the minimum of A’s max- 
imum expected loss is equal to the maximum of B’s 
minimum expected gain. This result, known as the 
minimax theorem, was first established in general- 
ity by the mathematician John von Neumann and 
is the fundamental result in the mathematical disci- 
pline known as the theory of games. The common 
value is called the value of the game to player B. 
Two coins are to be flipped. The first coin will land 
on heads with probability .6, the second with prob- 
ability .7. Assume that the results of the flips are 
independent, and let X equal the total number of 
heads that result. 

(a) Find P(X = 1}. 

(b) Determine ELX]. 

One of the numbers 1 through 10 is randomly cho- 

sen. You are to try to guess the number chosen by 

asking questions with “yes—no” answers. Compute 
the expected number of questions you will need to 
ask in each of the following two cases: 

(a) Your ith question is to be “Is it 7?” i = 
1, 2, 3, 4, 5, 6, 7, 8, 9, 10. 

(b) With each question you try to eliminate one- 
half of the remaining numbers, as nearly as 
possible. 

An insurance company writes a policy to the effect 
that an amount of money A must be paid if some 
event E occurs within a year. If the company esti- 
mates that E will occur within a year with probabil- 
ity p, what should it charge the customer in order 
that its expected profit will be 10 percent of A? 
A sample of 3 items is selected at random from a 
box containing 20 items of which 4 are defective. 
Find the expected number of defective items in the 
sample. 
There are two possible causes for a breakdown of 
a machine. To check the first possibility would cost 
C, dollars, and, if that were the cause of the break- 
down, the trouble could be repaired at a cost of R; 
dollars. Similarly, there are costs C2 and R2 asso- 
ciated with the second possibility. Let p and 1 — 
p denote, respectively, the probabilities that the 
breakdown is caused by the first and second possi- 
bilities. Under what conditions on p, Cj, Rj, i = 1,2, 
should we check the first possible cause of break- 
down and then the second, as opposed to reversing 
the checking order, so as to minimize the expected 
cost involved in returning the machine to working 
order? 
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Note: If the first check is negative, we must still 
check the other possibility. 

A person tosses a fair coin until a tail appears for 

the first time. If the tail appears on the nth flip, the 

person wins 2” dollars. Let X denote the player’s 
winnings. Show that E[X] = +oo. This problem is 
known as the St. Petersburg paradox. 

(a) Would you be willing to pay $1 million to play 
this game once? 

(b) Would you be willing to pay $1 million for 
each game if you could play for as long as 
you liked and only had to settle up when you 
stopped playing? 

Each night different meteorologists give us the 
probability that it will rain the next day. To judge 
how well these people predict, we will score each 
of them as follows: If a meteorologist says that it 
will rain with probability p, then he or she will 
receive a score of 


1— (1 — p) 
1 — p? 


if it does rain 
if it does not rain 


We will then keep track of scores over a cer- 
tain time span and conclude that the meteorologist 
with the highest average score is the best predictor 
of weather. Suppose now that a given meteorolo- 
gist is aware of our scoring mechanism and wants 
to maximize his or her expected score. If this per- 
son truly believes that it will rain tomorrow with 
probability p*, what value of p should he or she 
assert so as to maximize the expected score? 

To determine whether they have a certain dis- 
ease, 100 people are to have their blood tested. 
However, rather than testing each individual sepa- 
rately, it has been decided first to place the peo- 
ple into groups of 10. The blood samples of the 
10 people in each group will be pooled and ana- 
lyzed together. If the test is negative, one test will 
suffice for the 10 people, whereas if the test is posi- 
tive, each of the 10 people will also be individually 
tested and, in all, 11 tests will be made on this 
group. Assume that the probability that a person 
has the disease is .1 for all people, independently 
of each other, and compute the expected number 
of tests necessary for each group. (Note that we are 
assuming that the pooled test will be positive if at 
least one person in the pool has the disease.) 

A newsboy purchases papers at 10 cents and sells 
them at 15 cents. However, he is not allowed to 
return unsold papers. If his daily demand is a bino- 
mial random variable with n = 10,p = oe approxi- 
mately how many papers should he purchase so as 
to maximize his expected profit? 

In Example 4b, suppose that the department store 
incurs an additional cost of c for each unit of unmet 
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demand. (This type of cost is often referred to as 
a goodwill cost because the store loses the good- 
will of those customers whose demands it can- 
not meet.) Compute the expected profit when the 
store stocks s units, and determine the value of s 
that maximizes the expected profit. 

A box contains 5 red and 5 blue marbles. Two mar- 
bles are withdrawn randomly. If they are the same 
color, then you win $1.10; if they are different col- 
ors, then you win —$1.00. (That is, you lose $1.00.) 
Calculate 

(a) the expected value of the amount you win; 
(b) the variance of the amount you win. 
Consider Problem 22 with i = 2. Find the variance 
of the number of games played, and show that this 
number is maximized when p = 5. 

Find Var(X) and Var(Y) for X and Y as given in 
Problem 21. 

If ELX] = 1 and Var(X) = 5, find 

(a) E[(2 + X)?]; 

(b) Var(4 + 3X). 

A ball is drawn from an urn containing 3 white and 
3 black balls. After the ball is drawn, it is replaced 
and another ball is drawn. This process goes on 
indefinitely. What is the probability that, of the 
first 4 balls drawn, exactly 2 are white? 

On a multiple-choice exam with 3 possible answers 
for each of the 5 questions, what is the probability 
that a student will get 4 or more correct answers 
just by guessing? 

A man claims to have extrasensory perception. As 
a test, a fair coin is flipped 10 times and the man is 
asked to predict the outcome in advance. He gets 
7 out of 10 correct. What is the probability that 
he would have done at least this well if he had no 
ESP? 

Suppose that, in flight, airplane engines will fail 
with probability 1 — p, independently from engine 
to engine. If an airplane needs a majority of its 
engines operative to complete a successful flight, 
for what values of p is a 5-engine plane preferable 
to a 3-engine plane? 

A communications channel transmits the digits 0 
and 1. However, due to static, the digit transmitted 
is incorrectly received with probability .2. Suppose 
that we want to transmit an important message 
consisting of one binary digit. To reduce the 
chance of error, we transmit 00000 instead of 0 and 
11111 instead of 1. If the receiver of the message 
uses “majority” decoding, what is the probability 
that the message will be wrong when decoded? 
What independence assumptions are you making? 
A satellite system consists of m components and 
functions on any given day if at least k of the n 
components function on that day. On a rainy day 
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each of the components independently functions 
with probability p;, whereas on a dry day they each 
independently function with probability p2. If the 
probability of rain tomorrow is a, what is the prob- 
ability that the satellite system will function? 

A student is getting ready to take an important 
oral examination and is concerned about the pos- 
sibility of having an “on” day or an “off” day. He 
figures that if he has an on day, then each of his 
examiners will pass him, independently of each 
other, with probability .8, whereas if he has an off 
day, this probability will be reduced to .4. Sup- 
pose that the student will pass the examination if a 
majority of the examiners pass him. If the student 
feels that he is twice as likely to have an off day as 
he is to have an on day, should he request an exam- 
ination with 3 examiners or with 5 examiners? 
Suppose that it takes at least 9 votes from a 12- 
member jury to convict a defendant. Suppose also 
that the probability that a juror votes a guilty per- 
son innocent is .2, whereas the probability that the 
juror votes an innocent person guilty is .1. If each 
juror acts independently and if 65 percent of the 
defendants are guilty, find the probability that the 
jury renders a correct decision. What percentage 
of defendants is convicted? 


In some military courts, 9 judges are appointed. 
However, both the prosecution and the defense 
attorneys are entitled to a peremptory challenge 
of any judge, in which case that judge is removed 
from the case and is not replaced. A defendant is 
declared guilty if the majority of judges cast votes 
of guilty, and he or she is declared innocent other- 
wise. Suppose that when the defendant is, in fact, 
guilty, each judge will (independently) vote guilty 
with probability .7, whereas when the defendant is, 
in fact, innocent, this probability drops to .3. 

(a) What is the probability that a guilty defendant 
is declared guilty when there are (i) 9, (ii) 8, 
and (iii) 7 judges? 

Repeat part (a) for an innocent defendant. 

If the prosecution attorney does not exercise 
the right to a peremptory challenge of a judge, 
and if the defense is limited to at most two 
such challenges, how many challenges should 
the defense attorney make if he or she is 60 
percent certain that the client is guilty? 


(b) 
(c) 


It is known that diskettes produced by a cer- 
tain company will be defective with probability 
.01, independently of each other. The company 
sells the diskettes in packages of size 10 and 
offers a money-back guarantee that at most 1 of 
the 10 diskettes in the package will be defective. 
The guarantee is that the customer can return the 
entire package of diskettes if he or she finds more 
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than one defective diskette in it. If someone buys 
3 packages, what is the probability that he or she 
will return exactly 1 of them? 


When coin 1 is flipped, it lands on heads with prob- 

ability .4; when coin 2 is flipped, it lands on heads 

with probability .7. One of these coins is randomly 

chosen and flipped 10 times. 

(a) What is the probability that the coin lands on 
heads on exactly 7 of the 10 flips? 

(b) Given that the first of these ten flips lands 
heads, what is the conditional probability that 
exactly 7 of the 10 flips land on heads? 


Suppose that a biased coin that lands on heads with 

probability p is flipped 10 times. Given that a total 

of 6 heads results, find the conditional probability 

that the first 3 outcomes are 

(a) hh, t, t (meaning that the first flip results in 
heads, the second in tails, and the third in 
tails); 

(b) ¢,h, t. 


The expected number of typographical errors on a 
page of a certain magazine is .2. What is the prob- 
ability that the next page you read contains (a) 0 
and (b) 2 or more typographical errors? Explain 
your reasoning! 


The monthly worldwide average number of air- 
plane crashes of commercial airlines is 3.5. What 
is the probability that there will be 

(a) at least 2 such accidents in the next month; 
(b) at most 1 accident in the next month? 
Explain your reasoning! 


Approximately 80,000 marriages took place in the 

state of New York last year. Estimate the proba- 

bility that, for at least one of these couples, 

(a) both partners were born on April 30; 

(b) both partners celebrated their birthday on the 
same day of the year. 

State your assumptions. 


Suppose that the average number of cars aban- 
doned weekly on a certain highway is 2.2. Approx- 
imate the probability that there will be 

(a) no abandoned cars in the next week; 

(b) at least 2 abandoned cars in the next week. 


A certain typing agency employs 2 typists. The 
average number of errors per article is 3 when 
typed by the first typist and 4.2 when typed by the 
second. If your article is equally likely to be typed 
by either typist, approximate the probability that it 
will have no errors. 


How many people are needed so that the probabil- 
ity that at least one of them has the same birthday 
as you is greater than 5? 
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Suppose that the number of accidents occurring on 

a highway each day is a Poisson random variable 

with parameter i = 3. 

(a) Find the probability that 3 or more accidents 
occur today. 

(b) Repeat part (a) under the assumption that at 
least 1 accident occurs today. 


Compare the Poisson approximation with the cor- 
rect binomial probability for the following cases: 
(a) P{X = 2} whenn = 8,p = .1; 

(b) P{X = 9} when n = 10, p = .95; 

(c) P{X = 0} whenn = 10, p = .1; 

(d) P{X = 4} whenn = 9, p = .2. 


If you buy a lottery ticket in 50 lotteries, in each of 
which your chance of winning a prize is a what 
is the (approximate) probability that you will win 
a prize 

(a) at least once? 

(b) exactly once? 

(c) at least twice? 


The number of times that a person contracts a cold 
in a given year is a Poisson random variable with 
parameter 4 = 5. Suppose that a new wonder drug 
(based on large quantities of vitamin C) has just 
been marketed that reduces the Poisson parame- 
ter to X = 3 for 75 percent of the population. For 
the other 25 percent of the population, the drug 
has no appreciable effect on colds. If an individ- 
ual tries the drug for a year and has 2 colds in that 
time, how likely is it that the drug is beneficial for 
him or her? 


The probability of being dealt a full house in a 
hand of poker is approximately .0014. Find an 
approximation for the probability that, in 1000 
hands of poker, you will be dealt at least 2 full 
houses. 


Consider n independent trials, each of which 

results in one of the outcomes 1,..., with respec- 

tive probabilities p1,...,px, 54 pi = 1. Show 

that if all the p; are small, then the probability that 

no trial outcome occurs more than once is approx- 

imately equal to exp(—n(n — 1) Sr: 

People enter a gambling casino at a rate of 1 every 

2 minutes. 

(a) What is the probability that no one enters 
between 12:00 and 12:05? 

(b) What is the probability that at least 4 people 
enter the casino during that time? 


The suicide rate in a certain state is 1 suicide per 

100,000 inhabitants per month. 

(a) Find the probability that, in a city of 400,000 
inhabitants within this state, there will be 8 or 
more suicides in a given month. 
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(b) What is the probability that there will be at 
least 2 months during the year that will have 8 
or more suicides? 

Counting the present month as month num- 
ber 1, what is the probability that the first 
month to have 8 or more suicides will be 
month number i,i = 1? 

What assumptions are you making? 


(c) 


Each of 500 soldiers in an army company indepen- 

dently has a certain disease with probability 1/10°. 

This disease will show up in a blood test, and to 

facilitate matters, blood samples from all 500 sol- 

diers are pooled and tested. 

(a) What is the (approximate) probability that 
the blood test will be positive (that is, at least 
one person has the disease)? 

Suppose now that the blood test yields a positive 

result. 

(b) What is the probability, under this circum- 
stance, that more than one person has the dis- 
ease? 

One of the 500 people is Jones, who knows that he 

has the disease. 

(c) What does Jones think is the probability that 
more than one person has the disease? 

Because the pooled test was positive, the author- 

ities have decided to test each individual sepa- 

rately. The first i — 1 of these tests were negative, 
and the ith one—which was on Jones—was posi- 
tive. 

(d) Given the preceding, scenario, what is the 
probability, as a function of i, that any of the 
remaining people have the disease? 


A total of 2 people, consisting of m married cou- 

ples, are randomly seated (all possible orderings 

being equally likely) at a round table. Let Cj 

denote the event that the members of couple i are 

seated next to each other, i =1,...,n. 

(a) Find P(C)). 

(b) For] # i, find P(C;|C)). 

(c) Approximate the probability, for 7 large, that 
there are no married couples who are seated 
next to each other. 


Repeat the preceding problem when the seating is 
random but subject to the constraint that the men 
and women alternate. 


In response to an attack of 10 missiles, 500 antibal- 
listic missiles are launched. The missile targets of 
the antiballistic missiles are independent, and each 
antiballstic missile is equally likely to go towards 
any of the target missiles. If each antiballistic mis- 
sile independently hits its target with probability 
.1, use the Poisson paradigm to approximate the 
probability that all missiles are hit. 
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A fair coin is flipped 10 times. Find the probability 
that there is a string of 4 consecutive heads by 

(a) using the formula derived in the text; 

(b) using the recursive equations derived in the 
text. 

Compare your answer with that given by the 
Poisson approximation. 


(c) 


At time 0, a coin that comes up heads with prob- 
ability p is flipped and falls to the ground. Sup- 
pose it lands on heads. At times chosen accord- 
ing to a Poisson process with rate 1, the coin is 
picked up and flipped. (Between these times the 
coin remains on the ground.) What is the proba- 
bility that the coin is on its head side at time f? 
Hint What would be the conditional probability 
if there were no additional flips by time t, and 
what would it be if there were additional flips by 
time f? 

Consider a roulette wheel consisting of 38 num- 
bers 1 through 36, 0, and double 0. If Smith always 
bets that the outcome will be one of the numbers 1 
through 12, what is the probability that 

(a) Smith will lose his first 5 bets; 

(b) his first win will occur on his fourth bet? 


Two athletic teams play a series of games; the first 
team to win 4 games is declared the overall win- 
ner. Suppose that one of the teams is stronger than 
the other and wins each game with probability .6, 
independently of the outcomes of the other games. 
Find the probability, for i = 4, 5, 6, 7, that the 
stronger team wins the series in exactly i games. 
Compare the probability that the stronger team 
wins with the probability that it would win a 2-out- 
of-3 series. 


Suppose in Problem 72 that the two teams are 
evenly matched and each has probability i of win- 
ning each game. Find the expected number of 
games played. 


An interviewer is given a list of people she can 
interview. If the interviewer needs to interview 5 
people, and if each person (independently) agrees 
to be interviewed with probability 5, what is the 
probability that her list of people will enable her 
to obtain her necessary number of interviews if 
the list consists of (a) 5 people and (b) 8 people? 
For part (b), what is the probability that the inter- 
viewer will speak to exactly (c) 6 people and (d) 7 
people on the list? 


A fair coin is continually flipped until heads 
appears for the 10th time. Let X denote the num- 
ber of tails that occur. Compute the probability 
mass function of X. 


Solve the Banach match problem (Example 8e) 
when the left-hand matchbox originally contained 
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N, matches and the right-hand box contained N2 
matches. 
In the Banach matchbox problem, find the prob- 
ability that, at the moment when the first box is 
emptied (as opposed to being found empty), the 
other box contains exactly k matches. 
An urn contains 4 white and 4 black balls. We ran- 
domly choose 4 balls. If 2 of them are white and 
2 are black, we stop. If not, we replace the balls 
in the urn and again randomly select 4 balls. This 
continues until exactly 2 of the 4 chosen are white. 
What is the probability that we shall make exactly 
n Selections? 
Suppose that a batch of 100 items contains 6 that 
are defective and 94 that are not defective. If X 
is the number of defective items in a randomly 
drawn sample of 10 items from the batch, find (a) 
P{X = 0} and (b) P{X > 2}. 
A game popular in Nevada gambling casinos is 
Keno, which is played as follows: Twenty num- 
bers are selected at random by the casino from the 
set of numbers 1 through 80. A player can select 
from 1 to 15 numbers; a win occurs if some frac- 
tion of the player’s chosen subset matches any of 
the 20 numbers drawn by the house. The payoff is a 
function of the number of elements in the player’s 
selection and the number of matches. For instance, 
if the player selects only 1 number, then he or she 
wins if this number is among the set of 20, and 
the payoff is $2.2 won for every dollar bet. (As 
the player’s probability of winning in this case is 
i, it is clear that the “fair” payoff should be $3 
won for every $1 bet.) When the player selects 2 
numbers, a payoff (of odds) of $12 won for every 
$1 bet is made when both numbers are among 
the 20, 
(a) What would be the fair payoff in this case? 
Let P,, % denote the probability that exactly 
k of the n numbers chosen by the player are 
among the 20 selected by the house. 
(b) Compute Py, x 
(c) The most typical wager at Keno consists of 
selecting 10 numbers. For such a bet the 
casino pays off as shown in the following 
table. Compute the expected payoff: 


4.81 


4.82. 


4.83. 


4.84. 


4.85. 
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Keno Payoffs in 10 Number Bets 


Number of matches Dollars won for each $1 bet 


0-4 -1 


2,599 
24,999 


SOO ANANAMN 
= 
N 
\O 
\O 


= 


In Example 8i, what percentage of i defective lots 
does the purchaser reject? Find it fori = 1,4. 
Given that a lot is rejected, what is the condi- 
tional probability that it contained 4 defective 
components? 
A purchaser of transistors buys them in lots of 20. 
It is his policy to randomly inspect 4 components 
from a lot and to accept the lot only if all 4 are 
nondefective. If each component in a lot is, inde- 
pendently, defective with probability .1, what pro- 
portion of lots is rejected? 
There are three highways in the county. The num- 
ber of daily accidents that occur on these high- 
ways are Poisson random variables with respective 
parameters .3,.5, and .7. Find the expected num- 
ber of accidents that will happen on any of these 
highways today. 
Suppose that 10 balls are put into 5 boxes, with 
each ball independently being put in box 7 with 
probability p;, 7>_, pi = 1. 
(a) Find the expected number of boxes that do 
not have any balls. 
(b) Find the expected number of boxes that have 
exactly 1 ball. 
There are k types of coupons. Independently of 
the types of previously collected coupons, each 
new coupon collected is of type i with probability 
Pi a pi = 1. If n coupons are collected, find 
the expected number of distinct types that appear 
in this set. (That is, find the expected number of 
types of coupons that appear at least once in the 
set of nm coupons.) 


THEORETICAL EXERCISES 


There are N distinct types of coupons, and each 
time one is obtained it will, independently of 
past choices, be of type i with probability P;,i = 
1,...,.N. Let JT denote the number one need select 


to obtain at least one of each type. Compute 
P{T =n}. 

Hint: Use an argument similar to the one used in 
Example le. 
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4.2. 


4.3. 


4.4, 


4.5. 


4.6. 


4.7. 


4.8. 


4.9. 


4.10. 
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If X has distribution function F’, what is the distri- 
bution function of e¥? 

If X has distribution function F’,, what is the distri- 
bution function of the random variable aX + £, 
where @ and f are constants, a # 0? 


For a nonnegative integer-valued random vari- 
able N, show that 


=) PIN = i} 
P= 


CO CO 

= >) YS P{N = k}. Now inter- 
i=l k=i 

change fhe order of summation. 

For a nonnegative integer-valued random variable 
N, show that 


Hint: > PIN >i 


\iPIN > }= SEIN?) — E[N]) 


i=0 


Hint: S- iP(N i= a 3 P(N = k}. Now 


i=0 i=0 k=i+1 
interchange the order of summation. 
Let X be such that 


P(X =1=p=1 


fae eae 


Find c # 1 such that E[c*] = 1. 

Let X be a random variable having expected value 
w and variance o”. Find the expected value and 
variance of 

X— uw 


oO 


Y= 


Find Var(X) if 


P(X =a) =p=1 —- P(X =b) 


Show how the derivation of the binomial probabil- 
ities 


AX == (‘r'a an PO. 


leads to a proof of the binomial theorem 


n 


(x +4 yy" _ (i )y" 


i=0 


when x and y are enoniepauve, 
Hint: Let p= = 


Let X bea ving random variable with param- 
eters n and p. Show that 
| 1 = 
X+1) @+p 


4.11. 


4.12. 


4.13. 


4.14. 


4.15. 


4.16. 


4.17. 


Consider n independent sequential trials, each of 
which is successful with probability p. If there 
is a total of k successes, show that each of the 
n!\/[k!(n — k)!] possible arrangements of the k suc- 
cesses andn — k failures is equally likely. 


There are m components lined up in a linear 
arrangement. Suppose that each component inde- 
pendently functions with probability p. What is the 
probability that no 2 neighboring components are 
both nonfunctional? 

Hint: Condition on the number of defective com- 
ponents and use the results of Example 4c of 
Chapter 1. 


Let X be a binomial random variable with param- 
eters (n, p). What value of p maximizes P{LX = 
k},k = 0,1,...,n? This is an example of a sta- 
tistical method used to estimate p when a bino- 
mial (n, p) random variable is observed to equal 
k. If we assume that n is known, then we estimate 
p by choosing that value of p which maximizes 
P{X = k}. This is known as the method of maxi- 
mum likelihood estimation. 


A family has 1 children with probability wap”,n = 1, 

where aw = (1 — p)/p. 

(a) What proportion of families has no children? 

(b) If each child is equally likely to be a boy or a 
girl (independently of each other), what pro- 
portion of families consists of k boys (and any 
number of girls)? 


Suppose that n independent tosses of a coin having 
probability p of coming up heads are made. Show 
that the probability that an even number of heads 
results is s(t + (q — p)"], where g =1 — p.Do 
this by proving and then utilizing the identity 


[n/21 i 
» jer *=5[e +a" + @ - py") 


i=0 


where [7/2] is the largest integer less than or equal 
to n/2. Compare this exercise with Theoretical 
Exercise 3.5 of Chapter 3. 


Let X be a Poisson random variable with parame- 
ter A. Show that P{X = i} increases monotonically 
and then decreases monotonically as i increases, 
reaching its maximum when / is the largest integer 
not exceeding A. 

Hint: Consider P{X = i}/P{X =i — 1}. 


Let X be a Poisson random variable with 
parameter A. 
(a) Show that 


P{X is even} = [1 os | 


NIR 


4.18. 


4.19. 


4.20. 


4.21. 


by using the result of Theoretical Exercise 
15 and the relationship between Poisson and 
binomial random variables. 
(b) Verify the formula in part (a) directly by mak- 
ing use of the expansion of e~* + e*. 
Let X be a Poisson random variable with parame- 
ter 4. What value of A maximizes P{X = k},k = 0? 
Show that X is a Poisson random variable with 
parameter A, then 


E[X"] = AE[(X + 1)"71] 


Now use this result to compute ELX?]. 


Consider n coins, each of which independently 
comes up heads with probability p. Suppose that 
n is large and p is small, and let A = np. Suppose 
that all 7 coins are tossed; if at least one comes 
up heads, the experiment ends; if not, we again 
toss all 1 coins, and so on. That is, we stop the 
first time that at least one of the n coins come up 
heads. Let X denote the total number of heads that 
appear. Which of the following reasonings con- 
cerned with approximating P{X = 1} is correct 
(in all cases, Y is a Poisson random variable with 
parameter A)? 
(a) Because the total number of heads that occur 
when all n coins are rolled is approximately a 
Poisson random variable with parameter A, 


P(X =1} © P[Y =1}=ire% 


Because the total number of heads that occur 
when all 1 coins are rolled is approximately 
a Poisson random variable with parameter A, 
and because we stop only when this number is 
positive, 


(b) 


he* 
P(X =1} © P{Y =1|Y > 0} = ———_ 
1 — e 
(c) Because at least one coin comes up heads, X 
will equal 1 if none of the other n — 1 coins 
come up heads. Because the number of heads 
resulting from these n — 1 coins is approxi- 


mately Poisson with mean (n — 1)p * 4, 
P(X =1} © P{Y =0}=e% 


From a set of n randomly chosen people, let Ej 
denote the event that persons i and j have the same 
birthday. Assume that each person is equally likely 
to have any of the 365 days of the year as his or her 
birthday. Find 

(a) P(E34|F12); 

(b) P(E, 3/F12); 

(c) P(Eo3/Fi2 9 £43). 


4.22. 


4.23. 


4.24, 
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What can you conclude from your answers to 


parts (a)-(c) about the independence of the ( 5 ) 


events Ej? 
An urn contains 27 balls, of which 2 are numbered 
1, 2 are numbered 2,..., and 2 are numbered n. 


Balls are successively withdrawn 2 at a time with- 
out replacement. Let T denote the first selection 
in which the balls withdrawn have the same num- 
ber (and let it equal infinity if none of the pairs 
withdrawn has the same number). We want to 
show that, for0 < a < 1, 


lim P{T > an} =e %/? 
n 


To verify the preceding formula, let M@;, denote the 

number of pairs withdrawn in the first k selections, 

k=1,...,n. 

(a) Argue that when n is large, M, can be 
regarded as the number of successes in k 
(approximately) independent trials. 


(b) Approximate P{M; = 0} when n is large. 

(c) Write the event {T > an} in terms of the value 
of one of the variables Mx. 

(d) Verify the limiting probability given for 
P{T > an}. 

Consider a random collection of 1 individuals. In 


approximating the probability that no 3 of these 
individuals share the same birthday, a better Pois- 
son approximation than that obtained in the text 
(at least for values of n between 80 and 90) is 
obtained by letting F; be the event that there are 
at least 3 birthdays on day i,i = 1,...,365. 
(a) Find P(Ej). 
(b) Give an approximation for the probability 
that no 3 individuals share the same birthday. 
(c) Evaluate the preceding when n = 88 (which 
can be shown to be the smallest value of n for 
which the probability exceeds .5). 
Here is another way to obtain a set of recur- 
sive equations for determining P,, the probability 
that there is a string of k consecutive heads in a 
sequence of n flips of a fair coin that comes up 
heads with probability p: 
(a) Argue that, fork < n, there will be a string of 
k consecutive heads if either 


1. there is a string of k consecutive heads 
within the first n — 1 flips, or 

2. there is no string of k consecutive heads 
within the first n — k — 1 flips, flipn — k 
is a tail, and flipsn — k + 1,...,n are 
all heads. 


(b) Using the preceding, relate P, to P,,_1. Start- 
ing with P;, = p*, the recursion can be used to 
obtain Px, then Px,1, and so on, up to Py. 
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4.27. 


4.28. 


4.29. 


4.30. 
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Suppose that the number of events that occur 
in a specified time is a Poisson random variable 
with parameter A. If each event is counted with 
probability p, independently of every other event, 
show that the number of events that are counted 
is a Poisson random variable with parameter Ap. 
Also, give an intuitive argument as to why this 
should be so. As an application of the preceding 
result, suppose that the number of distinct ura- 
nium deposits in a given area is a Poisson random 
variable with parameter 4 = 10. If, in a fixed 
period of time, each deposit is discovered inde- 
pendently with probability ans find the probability 
that (a) exactly 1, (b) at least 1, and (c) at most 1 
deposit is discovered during that time. 

Prove 


e *x"dx 


Hint: Use integration by parts. 
If X is a geometric random variable, show analyti- 
cally that 


PiX=n4+khX > n=Pix=h 


Using the interpretation of a geometric random 
variable, give a verbal argument as to why the pre- 
ceding equation is true. 

Let X be a negative binomial random variable with 
parameters r and p, and let Y be a binomial ran- 
dom variable with parameters n and p. Show that 


P(X > n}=P{Y <7 


Hint: Either one could attempt an analytical proof 
of the preceding equation, which is equivalent to 
proving the identity 


oo r-1 
i— 1 r i-r 
yr) - m= E(4) 
i=n+1 i=0 
x pi(l _ py 


or one could attempt a proof that uses the prob- 
abilistic interpretation of these random variables. 
That is, in the latter case, start by considering a 
sequence of independent trials having a common 
probability p of success. Then try to express the 
events {X¥ > n} and {Y < r} in terms of the out- 
comes of this sequence. 

For a hypergeometric random variable, determine 


P(X =k + W/P{X =k 


Balls numbered 1 through WN are in an urn. Sup- 
pose that n,n = N, of them are randomly selected 


4.31. 


4.32. 


4.33. 


4.34. 


4.35. 


without replacement. Let Y denote the largest 

number selected. 

(a) Find the probability mass function of Y. 

(b) Derive an expression for E[Y] and then use 
Fermat’s combinatorial identity (see Theoret- 
ical Exercise 11 of Chapter 1) to simplify the 


expression. 
A jar contains m + n_ chips, numbered 
1,2,...,.n + m. A set of size n is drawn. If we 


let X denote the number of chips drawn having 
numbers that exceed each of the numbers of those 
remaining, compute the probability mass function 
of X. 

A jar contains n chips. Suppose that a boy succes- 
sively draws a chip from the jar, each time replac- 
ing the one drawn before drawing another. The 
process continues until the boy draws a chip that 
he has previously drawn. Let X denote the num- 
ber of draws, and compute its probability mass 
function. 

Show that Equation (8.6) follows from Equation 
(8.5). 

From a set of n elements, a nonempty subset is 
chosen at random in the sense that all of the 
nonempty subsets are equally likely to be selected. 
Let X denote the number of elements in the cho- 
sen subset. Using the identities given in Theoreti- 
cal Exercise 12 of Chapter 1, show that 


n 
E[X] = n—-1 
2 — (3) 
Var(X) = g2n—-2 —nn + 1)2"-2 
@ = 1) 
Show also that, for large, 
n 
Var(X) » — 
ar(X) mi 


in the sense that the ratio Var(X) to n/4 
approaches 1 as n approaches oo. Compare this 
formula with the limiting form of Var(Y) when 
PLY =} =1/n,1= 1,0. 

An.urn initially contains one red and one blue ball. 
At each stage, a ball is randomly chosen and then 
replaced along with another of the same color. Let 
X denote the selection number of the first chosen 
ball that is blue. For instance, if the first selec- 
tion is red and the second blue, then X is equal 
to 2. 
(a) 
(b) 


Find P{X > i},i = 1. 

Show that, with probability 1, a blue ball is 
eventually chosen. (That is, show that P{X < 
oo} = 1.) 


(c) Find ELX]. 


4.36. 


4.1. 


4.2. 


4.3. 


4.4. 


4.5. 


4.6. 


Suppose the possible values of X are {x;}, the pos- 
sible values of Y are {y;}, and the possible values 
of X + Y are {z;,}. Let Ax denote the set of all 
pairs of indices (i,j) such that x; + y; = z,; that is, 
Ax ={@f) Xi + Yj = Zk}- 

(a) Argue that 


Px+ Vegi] +) Pixarra 
(ifEAg 


(b) Show that 


EIX+Y]=>)° DO @ + w:P{X=x, 
k (ijeAg 


Y=y) 
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(c) Using the formula from part (b), argue that 


E[X + Y]=>0 Gu + yp) P(X = xi, 
ij 
rey 


(d) Show that 


Peas =) Pe Ha, F Sy): 
j 
PYSyj=) Axara) 


(e) Prove that 


E[X + Y] = £[X] + E[Y] 


SELF-TEST PROBLEMS AND EXERCISES 


Suppose that the random variable X is equal to 
the number of hits obtained by a certain base- 
ball player in his next 3 at bats. If PLY = 1} = 
3, P{X = 2} = .2, and P{X = 0} = 3P{X = 3}, 
find E[X]. 
Suppose that X takes on one of the values 0, 1, 
and 2. If for some constant c, PLY = i} = cP{X = 
i — 1},i= 1,2, find ELX]. 
A coin that, when flipped, comes up heads with 
probability p is flipped until either heads or tails 
has occurred twice. Find the expected number of 
flips. 
A certain community is composed of m families, 
r 


nj of which have i children, }° nj = m. If one of 


i=1 
the families is randomly chosen, let X denote the 
number of children in that family. If one of the 


ps 
>= in; children is randomly chosen, let Y denote 
i=1 

the total number of children in the family of that 
child. Show that E[Y] = E[X]. 
Suppose that P(X = 0} = 1 
E[X] = 3Var(X), find P(X = 0}. 
There are 2 coins in a bin. When one of them is 
flipped, it lands on heads with probability .6, and 
when the other is flipped, it lands on heads with 
probability .3. One of these coins is to be randomly 
chosen and then flipped. Without knowing which 
coin is chosen, you can bet any amount up to 10 
dollars, and you then either win that amount if the 
coin comes up heads or lose it if it comes up tails. 
Suppose, however, that an insider is willing to sell 
you, for an amount C, the information as to which 
coin was selected. What is your expected payoff 
if you buy this information? Note that if you buy 


P(X = 1). If 


4.7. 


it and then bet x, you will end up either winning 
x — Cor -—x — C (that is, losing x + C in the lat- 
ter case). Also, for what values of C does it pay to 
purchase the information? 


A philanthropist writes a positive number x on a 
piece of red paper, shows the paper to an impar- 
tial observer, and then turns it face down on the 
table. The observer then flips a fair coin. If it shows 
heads, she writes the value 2x and, if tails, the value 
x/2, on a piece of blue paper, which she then turns 
face down on the table. Without knowing either 
the value x or the result of the coin flip, you have 
the option of turning over either the red or the 
blue piece of paper. After doing so and observing 
the number written on that paper, you may elect 
to receive as a reward either that amount or the 
(unknown) amount written on the other piece of 
paper. For instance, if you elect to turn over the 
blue paper and observe the value 100, then you 
can elect either to accept 100 as your reward or 
to take the amount (either 200 or 50) on the red 
paper. Suppose that you would like your expected 
reward to be large. 

(a) Argue that there is no reason to turn over the 
red paper first, because if you do so, then no 
matter what value you observe, it is always 
better to switch to the blue paper. 

Let y be a fixed nonnegative value, and con- 
sider the following strategy: Turn over the 
blue paper, and if its value is at least y, then 
accept that amount. If it is less than y, then 
switch to the red paper. Let Ry(x) denote the 
reward obtained if the philanthropist writes 
the amount x and you employ this strat- 
egy. Find E[Ry(x)]. Note that E[Ro(x)] is the 


(b) 
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4.8. 


4.9. 


4.10. 


4.11. 


4.12. 


4.13. 


4.14. 


4.15. 
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expected reward if the philanthropist writes 
the amount x when you employ the strategy 
of always choosing the blue paper. 

Let B(n, p) represent a binomial random variable 

with parameters 1 and p. Argue that 


P{B(n,p) < i} =1 — P{B(n.1 — p)<n-i-Y 


Hint: The number of successes less than or equal to 
iis equivalent to what statement about the number 
of failures? 


If X is a binomial random variable with expected 
value 6 and variance 2.4, find P(X = 5}. 

An urn contains n balls numbered 1 through n. If 
you withdraw m balls randomly in sequence, each 
time replacing the ball selected previously, find 
P{X =k},k =1,...,m, where X is the maximum 
of the m chosen numbers. 

Hint: First find P{X = ky}. 

Teams A and B play a series of games, with the 
first team to win 3 games being declared the winner 
of the series. Suppose that team A independently 
wins each game with probability p. Find the condi- 
tional probability that team A wins 

(a) the series given that it wins the first game; 

(b) the first game given that it wins the series. 

A local soccer team has 5 more games left to play. 
If it wins its game this weekend, then it will play 
its final 4 games in the upper bracket of its league, 
and if it loses, then it will play its final games in 
the lower bracket. If it plays in the upper bracket, 
then it will independently win each of its games in 
this bracket with probability .4, and if it plays in 
the lower bracket, then it will independently win 
each of its games with probability .7. If the proba- 
bility that the team wins its game this weekend is 
.5, what is the probability that it wins at least 3 of 
its final 4 games? 

Each of the members of a 7-judge panel inde- 
pendently makes a correct decision with probabil- 
ity .7. If the panel’s decision is made by majority 
rule, what is the probability that the panel makes 
the correct decision? Given that 4 of the judges 
agreed, what is the probability that the panel made 
the correct decision? 

On average, 5.2 hurricanes hit a certain region in a 
year. What is the probability that there will be 3 or 
fewer hurricanes hitting this year? 

The number of eggs laid on a tree leaf by an insect 
of a certain type is a Poisson random variable with 
parameter 4. However, such a random variable 
can be observed only if it is positive, since if it is 
0 then we cannot know that such an insect was on 
the leaf. If we let Y denote the observed number 
of eggs, then 


4.16. 


4.17. 


4.18. 


4.19. 


4.20. 


4.21. 


PLY =i} = PIX =i|X > 0} 


where X is Poisson with parameter i. Find E[Y]. 

Each of n boys and v7 girls, independently and ran- 

domly, chooses a member of the other sex. If a 

boy and girl choose each other, they become a 

couple. Number the girls, and let G; be the event 

that girl number 7 is part of a couple. Let Pp = 

1 — P(U'L, Gi) be the probability that no couples 

are formed. 

(a) What is P(G;)? 

(b) What is P(G;|G;)? 

(c) When nis large, approximate Po. 

(d) When n is large, approximate Px, the proba- 
bility that exactly k couples are formed. 

(e) Use the inclusion—exclusion identity to evalu- 

ate Po. 

A total of 2 people, consisting of nm married cou- 

ples, are randomly divided into n pairs. Arbitrarily 

number the women, and let W; denote the event 

that woman / is paired with her husband. 

(a) Find P(W)). 

(b) Fori # j, find P(W;|W)). 

(c) When z is large, approximate the probability 
that no wife is paired with her husband. 

(d) If each pairing must consist of a man and a 

woman, what does the problem reduce to? 

A casino patron will continue to make $5 bets on 

red in roulette until she has won 4 of these bets. 

(a) What is the probability that she places a total 
of 9 bets? 

(b) What is her expected winnings when she 
stops? 

Remark: On each bet, she will either win $5 with 

probability 2 or lose $5 with probability a 

When three friends go for coffee, they decide who 

will pay the check by each flipping a coin and then 

letting the “odd person” pay. If all three flips pro- 

duce the same result (so that there is no odd per- 

son), then they make a second round of flips, and 

they continue to do so until there is an odd person. 

What is the probability that 

(a) exactly 3 rounds of flips are made? 

(b) more than 4 rounds are needed? 


Show that if X is a geometric random variable with 
parameter p, then 
—p| 
E[1/X] = —P log(p) 
=p 


Hint: You will need to evaluate an expression of 
the form )° a‘/i. To do so, write a’/i = fy x'~!dx, 


i=1 
and then interchange the sum and the integral. 
Suppose that 


P(X =a}=p, P{X=b}=1-—p 


4.22. 


4.23. 


4.24, 


(a) Show that Af is a Bernoulli random vari- 
able. 

(b) Find Var(X). 

Each game you play is a win with probability p. 

You plan to play 5 games, but if you win the fifth 

game, then you will keep on playing until you 

lose. 

(a) Find the expected number of games that 
you play. 

(b) Find the expected number of games that 
you lose. 

Balls are randomly withdrawn, one at a time with- 

out replacement, from an urn that initially has 

N white and M black balls. Find the probability 

that n white balls are drawn before m black balls, 

n=N,m=sM. 

Ten balls are to be distributed among 5 urns, 

with each ball going into urn 7 with probabil- 

ity pi, = 4 pi = 1. Let X; denote the number of 


4.25. 


4.26. 


Self-Test Problems and Exercises 185 
balls that go into urn 7. Assume that events cor- 
responding to the locations of different balls are 
independent. 


(a) What type of random variable is X;? Be as 
specific as possible. 

(b) For i # j, what type of random variable is 
Xi + Xj? 

(c) Find P{X; + X2 + X3 =7}. 

For the match problem (Example 5m in 


Chapter 2), find 
(a) the expected number of matches. 
(b) the variance of the number of matches. 


Let a be the probability that a geometric random 

variable X with parameter p is an even number. 

(a) Find @ by using the identity a = ) 
P{X = 2i}. 

(b) Find a by conditioning on whether X = 1 or 
xX > 1, 
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INTRODUCTION 

EXPECTATION AND VARIANCE OF CONTINUOUS RANDOM VARIABLES 
THE UNIFORM RANDOM VARIABLE 

NORMAL RANDOM VARIABLES 

EXPONENTIAL RANDOM VARIABLES 

OTHER CONTINUOUS DISTRIBUTIONS 

THE DISTRIBUTION OF A FUNCTION OF A RANDOM VARIABLE 


INTRODUCTION 


In Chapter 4, we considered discrete random variables—that is, random variables 
whose set of possible values is either finite or countably infinite. However, there also 
exist random variables whose set of possible values is uncountable. Two examples are 
the time that a train arrives at a specified stop and the lifetime of a transistor. Let X 
be such a random variable. We say that X is a continuous’ random variable if there 
exists a nonnegative function f, defined for all real x € (—oo, 00), having the property 
that, for any set B of real numbers,* 


P{X € B} = | fo dx (1.1) 
B 


The function f is called the probability density function of the random variable X. 
(See Figure 5.1.) 

In words, Equation (1.1) states that the probability that X will be in B may be 
obtained by integrating the probability density function over the set B. Since X must 
assume some value, f must satisfy 


1 = P{X € (—o0,co)} = [- f(x) dx 


All probability statements about X can be answered in terms of f. For instance, from 
Equation (1.1), letting B = [a,b], we obtain 


b 
Plas X <b} =, f(x) dx (1.2) 


t Sometimes called absolutely continuous. 


* Actually, for technical reasons Equation (1.1) is true only for the measurable sets B, which, 
fortunately, include all sets of practical interest. 
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a b 
P(a = X Sb) = area of shaded region 


FIGURE 5.1: Probability density function f. 


If we let a = b in Equation (1.2), we get 


Px =a)= [fade =0 


In words, this equation states that the probability that a continuous random variable 
will assume any fixed value is zero. Hence, for a continuous random variable, 


PX <ag=P{xX s a= Fa)= [ f(x) dx 


EXAMPLE Ia 


Suppose that X is a continuous random variable whose probability density function 
is given by 


_ C(4x — 2x7) 0<x <2 
FO) = | 0 otherwise 


(a) What is the value of C? 
(b) Find P{X > 1}. 


Solution. (a) Since f is a probability density function, we must have {3 f(x) dx =1, 
implying that 


2 
a) (4x — 2x*)dx =1 
0 


or 
c=2 
2x3 é 
C [a = =] =1 
3 x=0 
or 
3 
C= 2 
8 
Hence, 


by Px sheaf iias aC = Dx) dx = 5 
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EXAMPLE 1b 


The amount of time in hours that a computer functions before breaking down is a 
continuous random variable with probability density function given by 


re 70 y= Q 


wo [irr 


What is the probability that 


(a) a computer will function between 50 and 150 hours before breaking down? 
(b) it will function for fewer than 100 hours? 


Solution. (a) Since 


(oe) (oe) 
1= / f@dx= | e */100 dy 
—oo 0 


we obtain 


1 = —A(100)e*/1]° = 1002. or A= a 


Hence, the probability that a computer will function between 50 and 150 hours before 
breaking down is given by 


100 
= el? _ ¢3/* = 384 


i 1 100 100) 150 
P{50 < X < 150} -| ag e100 fe, pe) a 
50 


(b) Similarly, 
100 
PIX <100}= [ee gy = 08/1001 633 
9 100 0 


In other words, approximately 63.3 percent of the time, a computer will fail before 
registering 100 hours of use. | 


EXAMPLE Ic 


The lifetime in hours of a certain kind of radio tube is a random variable having a 
probability density function given by 


0 x = 100 
x)= 4 100 
x 


What is the probability that exactly 2 of 5 such tubes in a radio set will have to be 
replaced within the first 150 hours of operation? Assume that the events F;,i = 
1,2,3,4,5, that the ith such tube will have to be replaced within this time are 
independent. 
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Solution. From the statement of the problem, we have 


Hence, from the independence of the events £;, it follows that the desired probabil- 


ity is 
5\ (1\* (2\° _ 80 
2)\3) \3) ~ 243 a 


The relationship between the cumulative distribution F and the probability density 
f is expressed by 


a 
F(a) = P{X € (—c~, a]} = / f(x) dx 
—oo 
Differentiating both sides of the preceding equation yields 


“Fa =f@ 


That is, the density is the derivative of the cumulative distribution function. A some- 
what more intuitive interpretation of the density function may be obtained from 
Equation (1.2) as follows: 


é € a+e/2 
Pla-5sxsa+5}-/ f(x) dx ® ef(a) 
2 2 a—e/2 


when ¢ is small and when f(-) is continuous at x = a. In other words, the probability 
that X will be contained in an interval of length e around the point a is approximately 
ef (a). From this result we see that f(a) is a measure of how likely it is that the random 
variable will be near a. 


EXAMPLE Id 


If X is continuous with distribution function Fy and density function fy, find the 
density function of Y = 2X. 


Solution. We will determine fy in two ways. The first way is to derive, and then 
differentiate, the distribution function of Y: 
Fy(a) = P{Y = a} 
= P{2X = a} 
= P{X S a/2} 
= Fx (a/2) 


Differentiation gives 


1 
fri@= 5fx (a/2) 
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Another way to determine fy is to note that 


efy(a) = Pla — 5S ¥ sat 5} 
€ € 
=Pla-=<2X Sa+- 
la— 5 a+ 5} 
a € a € 
=P{---=X=-4- 
5 4 2 43 
~ Sfix(a/2) 
Dividing through by € gives the same result as before. | 


5.2 EXPECTATION AND VARIANCE OF CONTINUOUS RANDOM VARIABLES 
In Chapter 4, we defined the expected value of a discrete random variable X by 


E[X] =) xP{X =x} 


If X is a continuous random variable having probability density function f(x), then, 
because 
f(x)dx = P{fx = X =x + dx} for dx small 


it is easy to see that the analogous definition is to define the expected value of X by 


E[X] = i. xf (x) dx 


EXAMPLE 2a 
Find E[X] when the density function of X is 


2x if Os<x<1 
fa) = | 0 otherwise 


Solution. 
E[X] = [oto dx 
1 
a j 2x? dx 
0 
_ 2 
3 
EXAMPLE 2b 


The density function of X is given by 


lif OSsx<1 
f@) = | 0 otherwise 


Find E[e*]. 


Section 5.2 Expectation and Variance of Continuous Random Variables 191 


Solution. Let Y = e*. We start by determining Fy, the probability distribution func- 
tion of Y. Now, for! =x <e, 
Fy(x) = P{Y = x} 
= Ple* = x} 
= P{X = log(x)} 


log(x) 
-|/ f(y) dy 


= log(x) 
By differentiating Fy(x), we can conclude that the probability density function of Y 
is given by 


1 
fyw=- 1l=x<=e 
x 
Hence, 


E[e*] = E[Y] = [ xfy (x) dx 


é 
=f a 
1 


=e-1 
. 7 
Although the method employed in Example 2b to compute the expected value of 
a function of X is always applicable, there is, as in the discrete case, an alternative 
way of proceeding. The following is a direct analog of Proposition 4.1. of Chapter 4. 


Proposition 2.1. If X is a continuous random variable with probability density func- 
tion f(x), then, for any real-valued function g, 


E[g(X)] = 7 SX) f(x) dx 


An application of Proposition 2.1 to Example 2b yields 


1 
Ee*|= [ e* dx sincef(x)=1, O<x<1 
0 
=e-1 


which is in accord with the result obtained in that example. 

The proof of Proposition 2.1 is more involved than that of its discrete random 
variable analog. We will present such a proof under the provision that the random 
variable g(X) is nonnegative. (The general proof, which follows the argument in the 
case we present, is indicated in Theoretical Exercises 2 and 3.) We will need the fol- 
lowing lemma, which is of independent interest. 


Lemma 2.1 
For a nonnegative random variable Y, 


EY|= | P{Y > y}dy 
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Proof. We present a proof when Y is a continuous random variable with probabil- 
ity density function fy. We have 


[pv > vna=[o [ fromacay 
0 O dy 


where we have used the fact that P{Y > y} = es fy (x) dx. Interchanging the order 
of integration in the preceding equation yields 


[Pw > yhdy = f° ([ ay) fla) ds 


= [tre dx 
= E[Y] | 


Proof of Proposition 2.1. From Lemma 2.1, for any function g for which g(x) = 0, 


Ele(X)] = [ P{g(X) > y}dy 


oo 
-| i f(x) dx dy 
0 xig(x)>y 
8(x) 
— / i dy f (x) dx 
xig(x)>0 J0 


= / g(x)f (x) dx 
xig(x)>0 


which completes the proof. 


EXAMPLE 2c 


A stick of length 1 is split at a point U that is uniformly distributed over (0, 1). Deter- 
mine the expected length of the piece that contains the point p,0 = p = 1. 


Solution. Let Lp(U) denote the length of the substick that contains the point p, and 
note that 


1-UU<p 
LW) =| y U>p 


(See Figure 5.2.) Hence, from Proposition 2.1, 


1 
ElLp(w = f Lp(u) du 


Dp 1 
-| (1 — u)du + / udu 
0 Pp 


1 d-—p) , P 


i 
~ p) yy a 


+ pt — p) 


2 


NIRN 


Section 5.2 Expectation and Variance of Continuous Random Variables 193 


< 1-U > 
ee 
; @) 


ee 
0 P U j ®) 


FIGURE 5.2: Substick containing point p: (a) U < p; (b) U > p. 


Since p(1 — p) is maximized when p = 5 it is interesting to note that the expected 
length of the substick containing the point p is maximized when p is the midpoint of 
the original stick. Oo 


EXAMPLE 2d 


Suppose that if you are s minutes early for an appointment, then you incur the cost cs, 
and if you are s minutes late, then you incur the cost ks. Suppose also that the travel 
time from where you presently are to the location of your appointment is a continuous 
random variable having probability density function f. Determine the time at which 
you should depart if you want to minimize your expected cost. 


Solution. Let X denote the travel time. If you leave t minutes before your appoint- 
ment, then your cost—call it C;(X)—is given by 


_ jee@— xX) wx = 
C20 = | fx =f wx =7 


Therefore, 
ECO] = f° Ceoftey dv 
t (ee) 
-| c(t — x)f(x) dx + / k(x — Of(x) dx 
0 t 


t t (o-e) (oe) 
=a f f(x) dx — aI xf (x) dx + kf xf (x) dx — kt [ f(x) dx 
0 0 t t 


The value of ¢ that minimizes E[C;(X)] can now be obtained by calculus. Differentia- 
tion yields 


[CX)] = cat fO + cFO — ctfO — Mf@ + MFO — kl — FO] 
=(k+oF() —k 


—E 
dt 


Equating the rightmost side to zero shows that the minimal expected cost is obtained 
when you leave f* minutes before your appointment, where ¢* satisfies 


F(t‘) = 


k+ec 
As in Chapter 4, we can use Proposition 2.1 to show the following. 


Corollary 2.1. If a and 5 are constants, then 


E[aX + b] =aE[X] + b 
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The proof of Corollary 2.1 for a continuous random variable X is the same as the 
one given for a discrete random variable. The only modification is that the sum is 
replaced by an integral and the probability mass function by a probability density 
function. 

The variance of a continuous random variable is defined exactly as it is for a dis- 
crete random variable, namely, if X is a random variable with expected value yw, then 
the variance of X is defined (for any type of random variable) by 


Var(X) = E[(X — p)’] 
The alternative formula, 
Var(X) = ELX?] — (E[X])* 
is established in a manner similar to its counterpart in the discrete case. 


EXAMPLE 2e 
Find Var(X) for X as given in Example 2a. 


Solution. We first compute ELX’]. 


E[X?] = ie x°f (x) dx 


1 
— i. 2x? dx 
0 


Hence, since ELX] = , we obtain 


1 oe 
Matt) 5 (5) ~ 78 2 


It can be shown that, for constants a and b, 


Var(aX + b)= a’Var(X) 


The proof mimics the one given for discrete random variables. 

There are several important classes of continuous random variables that appear 
frequently in applications of probability; the next few sections are devoted to a study 
of some of them. 


5.3 THE UNIFORM RANDOM VARIABLE 


A random variable is said to be uniformly distributed over the interval (0, 1) if its 
probability density function is given by 


1 O<x<l 


f@) = 0 otherwise (3.1) 


Note that Equation (3.1) is a density function, since f(x) = 0 and i f(x)dx = 


i, dx = 1. Because f(x) > 0 only when x € (0,1), it follows that X must assume 
a value in interval (0, 1). Also, since f(x) is constant for x € (0,1), X is just as likely to 
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f(a) F(a) 
1 = 


(a) (b) 


FIGURE 5.3: Graph of (a) f(a) and (b) F(a) for a uniform (a, 8) random variable. 


be near any value in (0, 1) as it is to be near any other value. To verify this statement, 
note that, foranyO <a <b <1, 


b 
Plas xX sb)=| f@xy)dx=b—-a 


In other words, the probability that_X is in any particular subinterval of (0, 1) equals 
the length of that subinterval. 

In general, we say that X is a uniform random variable on the interval (a, 6) if the 
probability density function of X is given by 


i. 
St fag ee (3.2) 


0 otherwise 


Since F(a) = —_ f(x) dx, it follows from Equation (3.2) that the distribution function 
of a uniform random variable on the interval (a, 8) is given by 


0 az=a 
a-—a 

F(a)= a<a< 6B 
B-a 
1 a= Bp 


Figure 5.3 presents a graph of f(a) and F(a). 
EXAMPLE 3a 
Let X be uniformly distributed over (a, 8). Find (a) E[X] and (b) Var(X). 


Solution. (a) 


ELX| = [xf a 


B 
=). . dx 
a p-a 
Bp? — a? 
“26 a) 
ee 


2 
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In words, the expected value of a random variable that is uniformly distributed 
over some interval is equal to the midpoint of that interval. 


(b) To find Var(X), we first calculate ELX?]. 


a 
E[X?] = / x* dx 
a B — a 
B? — oa 
(3B — a) 
= B 4+ ap Ae a2 
7 3 
Hence, 
2 2 2 
Vatoe” + op +a (@ + B) 
3 4 
_@-ay 
~ 42 
Therefore, the variance of a random variable that is uniformly distributed over 
some interval is the square of the length of that interval divided by 12. | 
EXAMPLE 3b 


If _X is uniformly distributed over (0, 10), calculate the probability that (a) XY < 3, (b) 
X > 6,and(c)3 < X < 8. 


ca 3 

Solution. (a) P{X < a= | a a0 
age 4 
b) P{Xx > 6} = —dx= — 
) PIX > 6 =f ar=7 


(c) P{3 < X < 8} / ee d. : 
c = — dx = = 
< X < ; 10 x= 5 

EXAMPLE 3c 
Buses arrive at a specified stop at 15-minute intervals starting at 7 A.M. That is, they 
arrive at 7, 7:15, 7:30, 7:45, and so on. If a passenger arrives at the stop at a time that 
is uniformly distributed between 7 and 7:30, find the probability that he waits 

(a) less than 5 minutes for a bus; 

(b) more than 10 minutes for a bus. 


Solution. Let X denote the number of minutes past 7 that the passenger arrives at 
the stop. Since X is a uniform random variable over the interval (0, 30), it follows that 
the passenger will have to wait less than 5 minutes if (and only if) he arrives between 
7:10 and 7:15 or between 7:25 and 7:30. Hence, the desired probability for part (a) is 


15 1 30 1 1 
P(O < X < 15) + PQS < xX < 30 = [ ax + | dx = 
ae G0 3 


Similarly, he would have to wait more than 10 minutes if he arrives between 7 and 
7:05 or between 7:15 and 7:20, so the probability for part (b) is 


1 
PO < X < 5} + P(IS < X < 20)= 3 a 
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The next example was first considered by the French mathematician Joseph 
L. F. Bertrand in 1889 and is often referred to as Bertrand’s paradox. It represents 
our initial introduction to a subject commonly referred to as geometrical probability. 


EXAMPLE 3d 


Consider a random chord of a circle. What is the probability that the length of the 
chord will be greater than the side of the equilateral triangle inscribed in that circle? 


Solution. As stated, the problem is incapable of solution because it is not clear what 
is meant by a random chord. To give meaning to this phrase, we shall reformulate the 
problem in two distinct ways. 

The first formulation is as follows: The position of the chord can be determined 
by its distance from the center of the circle. This distance can vary between 0 and 
r, the radius of the circle. Now, the length of the chord will be greater than the side 
of the equilateral triangle inscribed in the circle if the distance from the chord to the 
center of the circle is less than r/2. Hence, by assuming that a random chord is a chord 
whose distance D from the center of the circle is uniformly distributed between 0 and 
r, we see that the probability that the length of the chord is greater than the side of 
an inscribed equilateral triangle is 


| | r/2 1 
Ui eee eeeearnees 
'f 2 


For our second formulation of the problem, consider an arbitrary chord of the cir- 
cle; through one end of the chord, draw a tangent. The angle 0 between the chord and 
the tangent, which can vary from 0° to 180°, determines the position of the chord. (See 
Figure 5.4.) Furthermore, the length of the chord will be greater than the side of the 
inscribed equilateral triangle if the angle 6 is between 60° and 120°. Hence, assuming 
that a random chord is a chord whose angle 6 is uniformly distributed between 0° and 
180°, we see that the desired answer in this formulation is 


120-60 1 
P(60 < 6 < 120}=— = 5 


Note that random experiments could be performed in such a way that 5 or 5 would 


be the correct probability. For instance, if a circular disk of radius r is thrown on a 

table ruled with parallel lines a distance 27 apart, then one and only one of these lines 

would cross the disk and form a chord. All distances from this chord to the center of 

the disk would be equally likely, so that the desired probability that the chord’s length 
1 


will be greater than the side of an inscribed equilateral triangle is 5. In contrast, if the 


FIGURE 5.4 
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experiment consisted of rotating a needle freely about a point A on the edge (see 
Figure 5.4) of the circle, the desired answer would be ; a 


5.4 NORMAL RANDOM VARIABLES 


We say that X is a normal random variable, or simply that X is normally distributed, 
with parameters jz and o° if the density of X is given by 


1 . 
f= oo —wo<x<o© 
Oo 


This density function is a bell-shaped curve that is symmetric about jz. (See Figure 5.5.) 


399 


399 


FIGURE 5.5: Normal density function: (a) 4. = 0,0 = 1; (b) arbitrary bh, o2. 


The normal distribution was introduced by the French mathematician Abraham 
DeMoivre in 1733, who used it to approximate probabilities associated with bino- 
mial random variables when the binomial parameter n is large. This result was later 
extended by Laplace and others and is now encompassed in a probability theorem 
known as the central limit theorem, which is discussed in Chapter 8. The central limit 
theorem, one of the two most important results in probability theory,’ gives a theo- 
retical base to the often noted empirical observation that, in practice, many random 
phenomena obey, at least approximately, a normal probability distribution. Some 
examples of random phenomena obeying this behavior are the height of a man, the 
velocity in any direction of a molecule in gas, and the error made in measuring a 
physical quantity. 

To prove that f(x) is indeed a probability density function, we need to show that 


1 
V200 


[o-@) 
/ Pa) ae | 
—oo 


+The other is the strong law of large numbers. 
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Making the substitution y = (x — «)/o, we see that 
1 


210 


—oo 20 —oo 


Hence, we must show that 


ioe) 2 — 
/ el? dy=V2n 


—oo 


Toward this end, let J = [© e~”’/? dy. Then 


2 ai —y?/2 . —x?/2 
— e? ‘dy e dx 


Co —0o 

Co Co 2,2 2 
= ; eT te )/ dy dx 

—00 J —0O 


We now evaluate the double integral by means of a change of variables to polar 
coordinates. (That is, let x = rcos@,y = rsin@, and dy dx = rdé dr.) Thus, 


oo p2r > 
Pa) i e" /*rd6 dr 
0 0 
CO 


= 2x f re’ dp 
0 

—r2/2|00 
=—2ne 7! lf 


= 2 


Hence, J = V2z, and the result is proved. 

An important fact about normal random variables is that if X is normally dis- 
tributed with parameters yz and o7, then Y = aX + bis normally distributed with 
parameters ay + b and a*o*. To prove this statement, suppose that a > 0. (The proof 
when a < Ois similar.) Let Fy denote the cumulative distribution function of Y. Then 


Fy(x) = P{Y = x} 


= PlaX +b <x} 


=p 
=pix as") 
a 


x—b 


= Fx( ) 


a 


where Fy is the cumulative distribution function of X. By differentiation, the density 
function of Y is then 


x—b 
a 


1 
fr@®= ptt ) 


ae, ae ee 
fon a 


J 20a 


-—— exp{—(@e — b — au)*/2(av)"} 


which shows that Y is normal with parameters au + b and a?o?. 
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An important implication of the preceding result is that if X is normally distributed 
with parameters jz and o”, then Z = (X¥ — j)/o is normally distributed with parame- 
ters 0 and 1. Such a random variable is said to be a standard, or a unit, normal random 
variable. 

We now show that the parameters jz and o? of anormal random variable represent, 
respectively, its expected value and variance. 


EXAMPLE 4a 
Find E[X] and Var(X) when_X is anormal random variable with parameters jz and o?. 


Solution. Let us start by finding the mean and variance of the standard normal ran- 
dom variable Z = (X — «w)/o. We have 


E[Z] = [ xfz(x) dx 


Thus, 
Var(Z) = E[Z’] 
1 Oe Be 24 
i xe X 
Vv 21 J—co 
Integration by parts (with u = x and dv = xe / *) now gives 


I —x?/2)00 —x?/2 
Var(Z) = Tax (xe fo 1 e dx) 
cd 


=o. 
1 [ —x*/2 
=> —= e dx 
V 20 —0o 
=1 
Because X = uw + oZ, the preceding yields the results 
E[X] =" 4+ cF[Z) =u 


and 
Var(X) = o?Var(Z) =o” a 


It is customary to denote the cumulative distribution function of a standard normal 
random variable by ®(x). That is, 


ox) = [ 22 q 
x) = ——= e 
J 20 —oo 


The values of ®(x) for nonnegative x are given in Table 5.1. For negative values of x, 
®(x) can be obtained from the relationship 


®(—x) = 1 — P(x) —-o3o<x<o (4.1) 
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TABLE 5.1: AREA ®(x) UNDER THE STANDARD NORMAL CURVE TO THE LEFT OF X 


xX 00 01 02 03 04 05 06 07 08 09 
0 5000 .5040 5080 512051605199 5239-5279 53195359 
1 5398 ©5438 = 54785517 6555755965636 56757145753 
2 5793-5832. .5871 = «5910 5948-5987 6026S «.6064.—Ssi«6103—S—«w 141 
3 6179 6217 6255 6293 6331 -=—«.6368~S «6406S 6443.—S «6480 ~—«6517 
4 6554 6591 6628 6664 6700 .6736 6772 6808  .6844 —.6879 
5 6915 6950 6985 .7019 .7054 .7088 .7123  .7157  .7190 7224 
6 7257 7291 ~=—«.7324.-—Ss 7357S s«7389S«.7422—Ss«7454.—Ss«7486—7517—S«7549 
7.7580 .7611 .7642 7673S «7704.—Ss«7734.—Ss«.7764.—S «7794. .7823—.7852 
8 .7881 7910 .7939 .7967 .7995 .8023 .8051 .8078 8106 8133 
9 8159 8186 8212 8238 .8264 .8289 8315 .8340 .8365 8389 


1.0 8413 8438 8461 8485 9.8508 ~=—.8531.— 85548577 8599 8621 
1.1 6.8643. 8665 ~— 8686. — 8708 ~— 8729.8 749 ~~ 8770 =~ 8790 ~——8 810 ~——.8830 
1.2 8849 8869 .8888  .8907 8925  .8944 .8962 .8980 .8997  .9015 
13.9032 =.9049- .9066— 9082, «9099 9115) 913191479162 9177 
14  .9192 9207 9222 .9236 8.9251 =.9265 =.9279 = 9292 9306 ~— 9319 
15.9332, 93459357 9370-9382 9394 94069418 94299441 
1.6 .9452 .9463 .9474 .9484 9495 9505 .9515  .9525  .9535 — .9545 
1.7 .9554 =.9564 9573 9582 9591 9599 9608 9616-9625 9633 
18 .9641 .9649 .9656 .9664 .9671 .9678 .9686 .9693 .9699 — .9706 
1.9 9713 9719 9726 .9732 .9738  =—.9744 975097569761 ~~ 9767 
2.0 9772 9778  .9783 .9788 9793 9798 ~— 9803s 9808 =~ 98129817 
2.1  .9821 .9826 .9830  .9834 .9838 .9842 .9846 .9850 .9854 = .9857 
2.2 .9861 .9864 .9868 .9871 .9875  .9878 .9881  .9884  .9887 —_.9890 
2.3 .9893 .9896 =.9898 =. 9901 —( 9904 9906 «9909 9911 9913S 9916 
24 9918 .9920 .9922 9925 .9927 .9929 .9931 .9932 .9934 .9936 
25 .9938 .9940 .9941 .9943 9945 .9946 .9948 .9949 .9951  .9952 
2.6 .9953 9955  .9956 .9957 .9959  .9960 .9961 .9962 .9963 .9964 
2.7 9965 .9966 .9967 .9968 .9969 .9970 .9971 .9972 .9973  .9974 
2.8 9974 9975 .9976 .9977 9977 .9978  .9979  .9979 .9980  .9981 
2.9 9981 .9982 .9982 .9983 .9984 .9984 .9985 .9985 .9986 .9986 
3.0 .9987 .9987 .9987 .9988 .9988 .9989 .9989 .9989 .9990  .9990 
3.1 9990 .9991 .9991 .9991 .9992 .9992 .9992 .9992 .9993  .9993 
3.2 .9993 .9993 .9994 .9994 .9994 .9994 .9994 9995 .9995 .9995 
3.3. .9995 .9995 .9995 .9996 .9996 .9996 .9996 .9996 .9996 .9997 
3.4 9997 9997 .9997 9997 9997 .9997  .9997 9997 .9997  .9998 


The proof of Equation (4.1), which follows from the symmetry of the standard nor- 
mal density, is left as an exercise. This equation states that if Z is a standard normal 
random variable, then 


P{Z Ss -—x} = P{Z > x} —-w<x<o 
Since Z = (X — y)/o is astandard normal random variable whenever X is normally 


distributed with parameters jz: and 07, it follows that the distribution function of X 
can be expressed as 


Fx( = PIX sa) =P(=—* = S—*) 9 (44) 
Oo 
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EXAMPLE 4b 


If _X is a normal random variable with parameters j. = 3 and o7 = 9, find (a) P{2 < 
X < 5}; (b) P{X > O}; (c) P{|X — 3] > 6}. 


Solution. (a) 


Pak FR S 3S 
PQ <X <5)=P| < < 
3 3 3 
= oe 
feed 
Se aue 
3 3 
2 1 
-0(5) [ (3)| a7 
(b) 
Pix > 0)=P{> > » Solo pz > -1 
=1— &(-1) 
= 0(1) 
= 8413 
(c) 
P{\X — 3| > 6} = P{[X > 9} + P(X < —3} 
=P{Xo3 > Poh 4 p[Xo3 «P53 
3 3 3 3 
SPi7Z = 2) + Piz 2—) 
=1— (2) + &(-2) 
= 2[1 — 0(2)] 
= .0456 
| 
EXAMPLE 4c 


An examination is frequently regarded as being good (in the sense of determining 
a valid grade spread for those taking it) if the test scores of those taking the exami- 
nation can be approximated by a normal density function. (In other words, a graph 
of the frequency of grade scores should have approximately the bell-shaped form of 
the normal density.) The instructor often uses the test scores to estimate the normal 
parameters jz and o? and then assigns the letter grade A to those whose test score 
is greater than « + o, B to those whose score is between su and uw + o, C to those 
whose score is between « — o and yp, D to those whose score is between « — 20 
and « — o,and F to those getting a score below 4 — 2c. (This strategy is sometimes 
referred to as grading “‘on the curve.”) Since 
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ye 
PX Si a= P| a 1} =1 - @(1) © 1587 
or 
X — pb 
Plu<X <wt a)=P{0 < < i} = ea) — ®(0) = 3413 
or 
Plu-o <X < p= {-1< ==* < of 
or 


P 
= &(0) — &(-1) © 3413 
P 


(oy 
= 0(2) — (1) © 1359 
—p 


x 
Plu - 20 < X <n ~o)=P{-2 « Lee if 


xX 
P{X < uw — 20} ee) < -2| = O(—2) © .0228 
it follows that approximately 16 percent of the class will receive an A grade on the 


examination, 34 percent a B grade, 34 percent a C grade, and 14 percent a D grade; 2 
percent will fail. 


EXAMPLE 4d 


An expert witness in a paternity suit testifies that the length (in days) of human ges- 
tation is approximately normally distributed with parameters 4. = 270 and o* = 100. 
The defendant in the suit is able to prove that he was out of the country during a 
period that began 290 days before the birth of the child and ended 240 days before 
the birth. If the defendant was, in fact, the father of the child, what is the probability 
that the mother could have had the very long or very short gestation indicated by the 
testimony? 


Solution. Let X denote the length of the gestation, and assume that the defendant 
is the father. Then the probability that the birth could occur within the indicated 
period is 


P{X > 2900rX < 240} = PLX > 290} + P{X < 240} 
X — 270 = 
=P 3 >2+ +P a7 < —3 
10 10 
=f = 60) 4 1 = 6G) 
= 0241 


EXAMPLE 4e 


Suppose that a binary message—either 0 or 1—must be transmitted by wire from 
location A to location B. However, the data sent over the wire are subject to a channel 
noise disturbance, so, to reduce the possibility of error, the value 2 is sent over the 
wire when the message is 1 and the value —2 is sent when the message is 0. If x, x = +2, 
is the value sent at location A, then R, the value received at location B, is given by 
R=x + N,where N is the channel noise disturbance. When the message is received 
at location B, the receiver decodes it according to the following rule: 


If R = .5, then 1 is concluded. 
IfR < .5, then 0 is concluded. 
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Because the channel noise is often normally distributed, we will determine the error 
probabilities when N is a standard normal random variable. 

Two types of errors can occur: One is that the message 1 can be incorrectly deter- 
mined to be 0, and the other is that 0 can be incorrectly determined to be 1. The first 
type of error will occur if the message is 1 and2 + N < .5, whereas the second will 
occur if the message is 0 and —2 + N = .5. Hence, 


P{error|message is 1} = P{N < —1.5} 
=1— (1.5) & .0668 


and 


P{error|message is 0} = P{N = 2.5} 
=1— (2.5) & .0062 


5.4.1 The Normal Approximation to the Binomial Distribution 


An important result in probability theory known as the DeMoivre—Laplace limit the- 
orem states that when n is large, a binomial random variable with parameters n and p 
will have approximately the same distribution as a normal random variable with the 
same mean and variance as the binomial. This result was proved originally for the spe- 
cial case of p = 5 by DeMoivre in 1733 and was then extended to general p by Laplace 
in 1812. It formally states that if we “standardize” the binomial by first subtracting its 
mean np and then dividing the result by its standard deviation ,/np(1 — p), then the 
distribution function of this standardized random variable (which has mean 0 and 
variance 1) will converge to the standard normal distribution function as noo. 


The DeMoivre-Laplace limit theorem 


If S,, denotes the number of successes that occur when n independent trials, each 
resulting in a success with probability p, are performed, then, for anya < b, 


Plas eae < b$}$+0(b) — O(a) 


vnp(l — p) 


as NO. 


Because the preceding theorem is only a special case of the central limit theorem, 
which is presented in Chapter 8, we shall not present a proof. 

Note that we now have two possible approximations to binomial probabilities: the 
Poisson approximation, which is good when n is large and p is small, and the normal 
approximation, which can be shown to be quite good when np(1 — p) is large. (See 
Figure 5.6.) [The normal approximation will, in general, be quite good for values of n 
satisfying np(1 — p) = 10.] 


EXAMPLE 4f 


Let X be the number of times that a fair coin that is flipped 40 times lands on heads. 
Find the probability that X¥ = 20. Use the normal approximation and then compare 
it with the exact solution. 
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10, 0.7 20, 0.7 
0.30 I. 0.20 es 


0.15 


0.20 4 il 
0.15 - 0.10 4 
0.10 F =] 
0.9 “—»_+—_1 | | 0.0 bsssa 22s re | | l Bu 
: ~ 0 5 10 15 
x 


20 


(30, 0.7) 


(50, 0.7) 


FIGURE 5.6: The probability mass function of a binomial (n, p) random variable becomes more and more 
“normal” as n becomes larger and larger. 


Solution. To employ the normal approximation, note that because the binomial is 
a discrete integer-valued random variable, whereas the normal is a continuous ran- 
dom variable, it is best to write P(X = i} as P{i — 1/2 < X < i+ 1/2} before 
applying the normal approximation (this is called the continuity correction). Doing 
SO gives 
P(X = 20} = P{19.5 = X < 20.5} 
195-20 xX — 20 20.5 — 20 
— < —— = —— 
V10 10 V10 


P| 16 X= 20 | ao} 


2 


/10 
= ©(.16) — ®(—.16) = .1272 
The exact result is £6 
40 1 
P{X = 20} = 0 5 = 1254 a 


EXAMPLE 4g 


The ideal size of a first-year class at a particular college is 150 students. The college, 
knowing from past experience that, on the average, only 30 percent of those accepted 
for admission will actually attend, uses a policy of approving the applications of 450 
students. Compute the probability that more than 150 first-year students attend this 
college. 


Solution. If X denotes the number of students that attend, then X is a binomial ran- 
dom variable with parameters n = 450 and p = .3. Using the continuity correction, 
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we see that the normal approximation yields 


X — (450)(.3) - 150.5 — (450)(.3) 


P{X = 150.5} = P = 
/450(.3)(.7) /450(.3)(.7) 


~1— (1.59) 

= .0559 
Hence, less than 6 percent of the time do more than 150 of the first 450 accepted 
actually attend. (What independence assumptions have we made?) | 
EXAMPLE 4h 


To determine the effectiveness of a certain diet in reducing the amount of cholesterol 
in the bloodstream, 100 people are put on the diet. After they have been on the diet 
for a sufficient length of time, their cholesterol count will be taken. The nutritionist 
running this experiment has decided to endorse the diet if at least 65 percent of the 
people have a lower cholesterol count after going on the diet. What is the probability 
that the nutritionist endorses the new diet if, in fact, it has no effect on the cholesterol 
level? 


Solution. Let us assume that if the diet has no effect on the cholesterol count, then, 
strictly by chance, each person’s count will be lower than it was before the diet with 
probability 5. Hence, if X is the number of people whose count is lowered, then the 
probability that the nutritionist will endorse the diet when it actually has no effect on 
the cholesterol count is 


100 100 
» <a (5) = P{X = 64.5} 


i=65 


X — (100)(5) _ 


=— Pt —______* 5979 
/ 100(5)(5) 
=~ 1 — (2.9) 
= .0019 | 


EXAMPLE 4i 


Fifty-two percent of the residents of New York City are in favor of outlawing cigarette 
smoking in publicly owned areas. Approximate the probability that more than 50 
percent of a random sample of n people from New York are in favor of this prohibi- 
tion when 


(a) n=11 
(b) #=101 
(c) n= 1001 


How large would n have to be to make this probability exceed .95? 


Solution. Let N denote the number of residents of New York City. To answer the 
preceding question, we must first understand that a random sample of size n is a 


sample such that the n people were chosen in such a manner that each of the 


subsets of n people had the same chance of being the chosen subset. Consequently, 
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S;,, the number of people in the sample who are in favor of the smoking prohibition, 
is a hypergeometric random variable. That is, S, has the same distribution as the 
number of white balls obtained when n balls are chosen from an urn of N balls, of 
which .52N are white. But because N and .52N are both large in comparison with the 
sample size n, it follows from the binomial approximation to the hypergeometric (see 
Section 4.8.3) that the distribution of S, is closely approximated by a binomial dis- 
tribution with parameters n and p = .52. The normal approximation to the binomial 
distribution then shows that 


Sn — .52n Sn — .52n 
P{Sn > sn) = P| Sas - ss 
Sy — .52n 
= | n52)(48) owvii 
= @(.04,/n) 


Thus, 
@(.1328) = 5528, ifn=11 
P{S, > 5n} % ~ ©(.4020) = .6562, ifn = 101 
® (1.2665) = .8973, ifn = 1001 


In order for this probability to be at least .95, we would need ®(.04,/n) > .95. Because 
®(x) is an increasing function and ®(1.645) = .95, this means that 


.04./n > 1.645 
or 
n = 1691.266 
That is, the sample size would have to be at least 1692. | 


Historical Notes Concerning the Normal Distribution 


The normal distribution was introduced by the French mathematician Abraham 
DeMoivre in 1733. DeMoivre, who used this distribution to approximate proba- 
bilities connected with coin tossing, called it the exponential bell-shaped curve. Its 
usefulness, however, became truly apparent only in 1809, when the famous German 
mathematician Karl Friedrich Gauss used it as an integral part of his approach to 
predicting the location of astronomical entities. As a result, it became common after 
this time to call it the Gaussian distribution. 

During the mid- to late 19th century, however, most statisticians started to 
believe that the majority of data sets would have histograms conforming to the 
Gaussian bell-shaped form. Indeed, it came to be accepted that it was “normal” 
for any well-behaved data set to follow this curve. As a result, following the lead of 
the British statistician Karl Pearson, people began referring to the Gaussian curve 
by calling it simply the normal curve. (A partial explanation as to why so many data 
sets conform to the normal curve is provided by the central limit theorem, which is 
presented in Chapter 8.) 


Abraham DeMoivre (1667-1754) 


Today there is no shortage of statistical consultants, many of whom ply their trade 
in the most elegant of settings. However, the first of their breed worked, in the early 
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years of the 18th century, out of a dark, grubby betting shop in Long Acres, London, 
known as Slaughter’s Coffee House. He was Abraham DeMoivre, a Protestant 
refugee from Catholic France, and, for a price, he would compute the probability of 
gambling bets in all types of games of chance. 

Although DeMoivre, the discoverer of the normal curve, made his living at the 
coffee shop, he was a mathematician of recognized abilities. Indeed, he was a mem- 
ber of the Royal Society and was reported to be an intimate of Isaac Newton. 

Listen to Karl Pearson imagining DeMoivre at work at Slaughter’s Coffee 
House: “I picture DeMoivre working at a dirty table in the coffee house with a broken- 
down gambler beside him and Isaac Newton walking through the crowd to his corner 
to fetch out his friend. It would make a great picture for an inspired artist.” 


Karl Friedrich Gauss 


Karl Friedrich Gauss (1777-1855), one of the earliest users of the normal curve, 
was one of the greatest mathematicians of all time. Listen to the words of the 
well-known mathematical historian E. T. Bell, as expressed in his 1954 book Men 
of Mathematics: In a chapter entitled “The Prince of Mathematicians,” he writes, 
“Archimedes, Newton, and Gauss; these three are in a class by themselves among 
the great mathematicians, and it is not for ordinary mortals to attempt to rank them 
in order of merit. All three started tidal waves in both pure and applied mathemat- 
ics. Archimedes esteemed his pure mathematics more highly than its applications; 
Newton appears to have found the chief justification for his mathematical inventions 
in the scientific uses to which he put them; while Gauss declared it was all one to him 
whether he worked on the pure or on the applied side.”* 


5.5 EXPONENTIAL RANDOM VARIABLES 


A continuous random variable whose probability density function is given, for some 
A > 0, by 


he ifx = 0 
f@) = 0 ifx <0 


is said to be an exponential random variable (or, more simply, is said to be exponen- 
tially distributed) with parameter 4. The cumulative distribution function F(a) of an 
exponential random variable is given by 


F(a) = P{X = a} 


a 
= re ** dx 
0 


=e lf 


=1=-¢" a2=0 
Note that F(co) = i de~** dx = 1, as, of course, it must. The parameter A will now 
be shown to equal the reciprocal of the expected value. 


EXAMPLE 5a 


Let X be an exponential random variable with parameter 1. Calculate (a) E[X] and 
(b) Var(X). 
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Solution. (a) Since the density function is given by 


her* x SO 


Leis | 0 x <0 
we obtain, forn > 0, 
CO 
E[x"] =f xe de 
0 


Integrating by parts (with A4e~**" 


= dv and u = x") yields 
[oe) 
E[X"] = —x"e7* | + / e* nx"! dx 
0 


n [o-<) 
=O0+ *f ne ** "1 dy 
A Jo 


n 
eae yl 
“E[X" 1] 
Letting n = 1 and then n = 2 gives 
1 
E[X] = - 
[xX] => 
2 2 
E[X*] = 5 EIX] = 5 
(b) Hence, 
2 1\° 1 
Var(X) = ) (;) = 52 


Thus, the mean of the exponential is the reciprocal of its parameter 4, and the vari- 
ance is the mean squared. | 


In practice, the exponential distribution often arises as the distribution of the 
amount of time until some specific event occurs. For instance, the amount of time 
(starting from now) until an earthquake occurs, or until a new war breaks out, or 
until a telephone call you receive turns out to be a wrong number are all random 
variables that tend in practice to have exponential distributions. (For a theoretical 
explanation of this phenomenon, see Section 4.7.) 


EXAMPLE 5b 


Suppose that the length of a phone call in minutes is an exponential random variable 
with parameter 7 = a If someone arrives immediately ahead of you at a public 
telephone booth, find the probability that you will have to wait 


(a) more than 10 minutes; 
(b) between 10 and 20 minutes. 


Solution. Let X denote the length of the call made by the person in the booth. Then 
the desired probabilities are 


(a) 
P{X > 10}=1 — F(10) 
—e! & 368 
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(b) 
P{10 < X < 20} = F0) — F(10) 
=e! = eo? w 2933 a 


We say that a nonnegative random variable X is memoryless if 
PX >s+t|X > t=P{X > 5s} foralls,t=0 (5.1) 


If we think of X as being the lifetime of some instrument, Equation (5.1) states that 
the probability that the instrument survives for at least s++¢ hours, given that it has 
survived ¢ hours, is the same as the initial probability that it survives for at least s 
hours. In other words, if the instrument is alive at age f, the distribution of the remain- 
ing amount of time that it survives is the same as the original lifetime distribution. 
(That is, it is as if the instrument does not “remember” that it has already been in use 
for a time ¢.) 
Equation (5.1) is equivalent to 


P{X >s+t,X > t} 


= P{X > s} 
P{X > t} 


or 
P(X >s+H=P{X > s}P[IX > h (5.2) 


Since Equation (5.2) is satisfied when X is exponentially distributed (for e~*°t? = 
ee), it follows that exponentially distributed random variables are memoryless. 


EXAMPLE 5c 


Consider a post office that is staffed by two clerks. Suppose that when Mr. Smith 
enters the system, he discovers that Ms. Jones is being served by one of the clerks 
and Mr. Brown by the other. Suppose also that Mr. Smith is told that his service will 
begin as soon as either Ms. Jones or Mr. Brown leaves. If the amount of time that 
a clerk spends with a customer is exponentially distributed with parameter 4, what 
is the probability that, of the three customers, Mr. Smith is the last to leave the post 
office? 


Solution. The answer is obtained by reasoning as follows: Consider the time at which 
Mr. Smith first finds a free clerk. At this point, either Ms. Jones or Mr. Brown would 
have just left, and the other one would still be in service. However, because the expo- 
nential is memoryless, it follows that the additional amount of time that this other 
person (either Ms. Jones or Mr. Brown) would still have to spend in the post office is 
exponentially distributed with parameter A. That is, it is the same as if service for that 
person were just starting at this point. Hence, by symmetry, the probability that the 
remaining person finishes before Smith leaves must equal 5. | 


It turns out that not only is the exponential distribution memoryless, but it is also 
the unique distribution possessing this property. To see this, suppose that X is mem- 
oryless and let F(x) = P{X > x}. Then, by Equation (5.2), 


F(s + t) = F(s)F(t) 
That is, F(-) satisfies the functional equation 


g(s + t) = g(s)g() 
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However, it turns out that the only right continuous solution of this functional 
equation ist 
sajee* (5.3) 


and, since a distribution function is always right continuous, we must have 
F(ixy)=e" or F(x) =P{(X <x}=1—e%* 
which shows that _X is exponentially distributed. 


EXAMPLE 5d 


Suppose that the number of miles that a car can run before its battery wears out is 
exponentially distributed with an average value of 10,000 miles. If a person desires to 
take a 5000-mile trip, what is the probability that he or she will be able to complete the 
trip without having to replace the car battery? What can be said when the distribution 
is not exponential? 


Solution. It follows by the memoryless property of the exponential distribution that 
the remaining lifetime (in thousands of miles) of the battery is exponential with 
parameter A = a Hence, the desired probability is 


P{remaining lifetime > 5} = 1 — F(5) = e =e? = 604 


However, if the lifetime distribution F is not exponential, then the relevant probabil- 
ity is 
1 — Fi + 5) 


Pi{lifetime > t + 5|lifetime > t} = i Fo 


where ¢ is the number of miles that the battery had been in use prior to the start of 
the trip. Therefore, if the distribution is not exponential, additional information is 
needed (namely, the value of t) before the desired probability can be calculated. 


A variation of the exponential distribution is the distribution of a random variable 
that is equally likely to be either positive or negative and whose absolute value is 
exponentially distributed with parameter 4,4 = 0. Such a random variable is said to 
have a Laplace distribution,* and its density is given by 


1 
f@wM= she —o <x <0 


TOne can prove Equation (5.3) as follows: If g(s + f) = g(s)g(t), then 


aa) a) 


and repeating this yields g(m/n) = g'(1/n). Also, 


L 7 1 1 1 
si =e(- $= pep “)=8'(5) or s(;,) = «ant 
n n n n n 


Hence, g(m/n) = (g(1))"/", which, since g is right continuous, implies that g(x) = (g(1))*. 


1 


2 
Because g(1) = (« (3)) = 0, we obtain g(x) = e~** 


, where A = — log(g(1)). 


tt also is sometimes called the double exponential random variable. 
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Its distribution function is given by 


x 
f re dx e210 
P(x) = a 1 ¢* 
4 f eax + 5 f ke de xe > 0 
—0o 2 0 
se x <0 
- 1 dee ys 0 
EXAMPLE 5e 


Consider again Example 4e, which supposes that a binary message is to be transmit- 
ted from A to B, with the value 2 being sent when the message is 1 and —2 when it is 
0. However, suppose now that, rather than being a standard normal random variable, 
the channel noise N is a Laplacian random variable with parameter A = 1. Suppose 
again that if R is the value received at location B, then the message is decoded as 
follows: 


If R = .5, then 1 is concluded. 
If R < .5, then 0 is concluded. 


In this case, where the noise is Laplacian with parameter 4 = 1, the two types of 
errors will have probabilities given by 


P{error|message 1 is sent} = P{N < —1.5} 


Aig 
2 
~ 1116 
P{error|message 0 is sent} = P{N = 2.5} 
_1 93 
2 
~ 041 


On comparing this with the results of Example 4e, we see that the error probabilities 
are higher when the noise is Laplacian with A = 1 than when it is a standard normal 
variable. 


5.5.1. Hazard Rate Functions 


Consider a positive continuous random variable X that we interpret as being the 
lifetime of some item. Let X have distribution function F and density f. The hazard 
rate (sometimes called the failure rate) function i(t) of F is defined by 


t = 
Mt) = fO where F=1— F 
F(t) 
To interpret A(t), suppose that the item has survived for a time ¢ and we desire the 
probability that it will not survive for an additional time dt. That is, consider P{X € 
(t,t + dt)|X > t}. Now, 
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P{X € (t,t + dh|X > th= a oe = 
_ P(X € (t,t + dt} 
~ Px sf 
~ fo dt 
F(t) 


Thus, A(¢) represents the conditional probability intensity that a f-unit-old item will fail. 
Suppose now that the lifetime distribution is exponential. Then, by the memoryless 
property, it follows that the distribution of remaining life for a t-year-old item is the 
same as that for a new item. Hence, A(f) should be constant. In fact, this checks out, 
since 
t 
A(t) = tO 
F(t) 
het 
ary 
=i 


Thus, the failure rate function for the exponential distribution is constant. The param- 
eter A is often referred to as the rate of the distribution. 

It turns out that the failure rate function A(t) uniquely determines the distribu- 
tion F. To prove this, note that, by definition, 


4 F(t) 


MO = TO 


Integrating both sides yields 


t 
log(1 — F(t)) = -| AOdt +k 
0 


t 
1-— FX =eex|- f X(0) | 
0 


Letting t = 0 shows that & = 0; thus, 


or 


t 
Fa =1—- ex [ A(t) | (5.4) 
0 


Hence, a distribution function of a positive continuous random variable can be 
specified by giving its hazard rate function. For instance, if a random variable has a 
linear hazard rate function—that is, if 


A(t) =a + bt 
then its distribution function is given by 
Fi) = i eo at—br? /2 


and differentiation yields its density, namely, 
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)=(a + bie MHF) p> Q 
fO=(a + bhe rr" 


When a = 0, the preceding equation is known as the Rayleigh density function. 


EXAMPLE 5f 


One often hears that the death rate of a person who smokes is, at each age, twice that 
of anonsmoker. What does this mean? Does it mean that a nonsmoker has twice the 
probability of surviving a given number of years as does a smoker of the same age? 


Solution. If 4;(t) denotes the hazard rate of a smoker of age ¢ and 4,,(¢) that of a 
nonsmoker of age ¢, then the statement at issue is equivalent to the statement that 


Ast) = 2hn (t) 
The probability that an A-year-old nonsmoker will survive until age B, A < B, is 


P{A-year-old nonsmoker reaches age B} 
= P{nonsmoker’s lifetime > B|nonsmoker’s lifetime > A} 
_ 1 _ Faon(B) 
~ 1 = Fhon(A) 


= from (5.4) 


whereas the corresponding probability for a smoker is, by the same reasoning, 


B 
P{A-year-old smoker reaches age B} = exp {- / As(t) | 
A 


B 
= exp {-2 An(t) ‘| 
A 
B 
= ex f inna} 
A 


In other words, for two people of the same age, one of whom is a smoker and 
the other a nonsmoker, the probability that the smoker survives to any given age 
is the square (not one-half) of the corresponding probability for a nonsmoker. For 
instance, if A,,(f) = 30° 50 = t = 60, then the probability that a 50-year-old nonsmoker 
reaches age 60 is e~!/> ~ .7165, whereas the corresponding probability for a smoker 
ise7/3 = 5134, a 


2 
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5.6 OTHER CONTINUOUS DISTRIBUTIONS 
5.6.1 The Gamma Distribution 
A random variable is said to have a gamma distribution with parameters (a, A), A > 0, 


a > 0, if its density function is given by 


he * (ax)?! 7, 
fe)= a7 
0 


where I'(a), called the gamma function, is defined as 
[o.e) 
I(a) =) ey! dy 
0 

Integration of (a) by parts yields 

00 (oe) 

rey = ae yt + / e (a — 1)y* dy 
0 


[ee) 
Sig <A) i eVyt2 dy (6.1) 
0 
=(a — 1)I'(a — 1) 
For integral values of a, say, a = n, we obtain, by applying Equation (6.1) repeatedly, 


T(n) = (n — 1)T(n — 1) 
=(n — 1)(n — 2) (n — 2) 


=(n — 1)(n — 2)---3 - 2T(1) 
Since (1) = io e-* dx = 1, it follows that, for integral values of n, 
T'(n) =(n — 1)! 


When a is a positive integer, say, a = n, the gamma distribution with parameters 
(a,4) often arises, in practice as the distribution of the amount of time one has to 
wait until a total of n events has occurred. More specifically, if events are occurring 
randomly and in accordance with the three axioms of Section 4.7, then it turns out 
that the amount of time one has to wait until a total of m events has occurred will be a 
gamma random variable with parameters (, A). To prove this, let T;,, denote the time 
at which the mth event occurs, and note that 7), is less than or equal to r if and only 
if the number of events that have occurred by time t¢ is at least n. That is, with N(t) 
equal to the number of events in [0, ¢], 


P{T, = t= P{N® = n} 


=>) PINO=) 
jen 
Ve (Ady 
=3 — 


j=n 
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where the final identity follows because the number of events in [0, t] has a 
Poisson distribution with parameter At. Differentiation of the preceding now yields 
the density function of T),: 


OO At; j—1 8 —At j 

_ e“j(Aty "2 re“ (At)! 
iOo= >, i > Fi 

j=n j=n 
Z 3 re anit s re ani 
~~ i; — 1)! i! 

j=n Y D! j=n P 
_ se“ OH! 
~~  (n — 1)! 


Hence, T,, has the gamma distribution with parameters (n,A). (This distribution is 
often referred to in the literature as the n-Erlang distribution.) Note that when n = 1, 
this distribution reduces to the exponential distribution. 

The gamma distribution with 4 = 5 and a = n/2,n a positive integer, is called the 
x2 (read “chi-squared”) distribution with n degrees of freedom. The chi-squared dis- 
tribution often arises in practice as the distribution of the error involved in attempt- 
ing to hit a target in n-dimensional space when each coordinate error is normally 
distributed. This distribution will be studied in Chapter 6, where its relation to the 
normal distribution is detailed. 


EXAMPLE 6a 


Let X be a gamma random variable with parameters w and A. Calculate (a) E[X] and 
(b) Var(X). 


Solution. (a) 


= it o —\x a—1l 
E|X] = na I Axe “*(Ax)% dx 


— / “ ne (ax)® dx 
AT (a) Jo 
rer) 


AT (a) 
— by Equation (6.1) 


(b) By first calculating ELX?], we can show that 
a 
Var(X) = 2 


The details are left as an exercise. i 


5.6.2. The Weibull Distribution 


The Weibull distribution is widely used in engineering practice due to its versatility. It 
was originally proposed for the interpretation of fatigue data, but now its use has been 
extended to many other engineering problems. In particular, it is widely used in the 
field of life phenomena as the distribution of the lifetime of some object, especially 
when the “weakest link” model is appropriate for the object. That is, consider an 
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object consisting of many parts, and suppose that the object experiences death (fail- 
ure) when any of its parts fail. It has been shown (both theoretically and empirically) 
that under these conditions a Weibull distribution provides a close approximation to 
the distribution of the lifetime of the item. 

The Weibull distribution function has the form 


0 xv 


F@)=), e| (= ")'| a (6.2) 


a 


A random variable whose cumulative distribution function is given by Equation (6.2) 
is said to be a Weibull random variable with parameters v,a, and 6. Differentiation 
yields the density: 


fx) = oe | (=) 
— exp ) — x>v 
a a a 
5.6.3. The Cauchy Distribution 


A random variable is said to have a Cauchy distribution with parameter 0,—o0 < 0 < 
oo, if its density is given by 


fos 
HO oe ae aren CO <= XY = OO: 


EXAMPLE 6b 

Suppose that a narrow-beam flashlight is spun around its center, which is located a 
unit distance from the x-axis. (See Figure 5.7.) Consider the point X at which the 
beam intersects the x-axis when the flashlight has stopped spinning. (If the beam is 
not pointing toward the x-axis, repeat the experiment.) 


X-axis 


FIGURE 5.7 


As indicated in Figure 5.7, the point X is determined by the angle 6 between the 
flashlight and the y-axis, which, from the physical situation, appears to be uniformly 
distributed between —z/2 and 2/2. The distribution function of X is thus given by 


F(x) = P{X S x} 
= P{tand = x} 
= P{6 < tan7! x} 
i} 


“ps ae 
— ia —tan Xx 
2 aa 
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where the last equality follows since 6, being uniform over (—72/2,7/2), has 
distribution 


Pio<a=—" cM 5+ e <a<e 
Hence, the density function of X is given by 
(jie : co = x =< 00 
dx m(1 + x) 
and we see that X has the Cauchy distribution.’ | 


5.6.4 The Beta Distribution 
A random variable is said to have a beta distribution if its density is given by 
1 


f(x) = 4 Bab) 
0) otherwise 


xt1q —x)! O<x <1 


where 


1 
Bia, b) =} xt1q — xP ax 
0 


The beta distribution can be used to model a random phenomenon whose set of 
possible values is some finite interval [c, d|—which, by letting c denote the origin and 
taking d — c asa unit measurement, can be transformed into the interval [0, 1]. 

When a = J, the beta density is symmetric about 5 giving more and more weight 
to regions about 5 as the common value a increases. (See Figure 5.8.) When b > a, 
the density is skewed to the left (in the sense that smaller values become more likely); 
and it is skewed to the right when a > b. (See Figure 5.9.) 

The relationship 

r@r) 


can be shown to exist between 


1 
Bia, b) = xt1q — xP ax 
0 


and the gamma function. 


*That 4 (tan—1 xy=1/d + x) can be seen as follows: If y = tan~1 x, then tan y = x, so 


d (=) dy _ (= + =?) dy 


1 i a tia ) = fai pO 
i a ca dy oe dy \cosy/ dx cos? y dx 


or 
dy _ cos? y 1 1 


dx sin2y + cos?y tamzy+1 2241 
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fx) 


FIGURE 5.8: Beta densities with parameters (a, b) when a = b. 


fx) 
A 


> X 


FIGURE 5.9: Beta densities with parameters (a, b) when a/(a + 6) = 1/20. 


Upon using Equation (6.1) along with the identity (6.3), it is an easy matter to show 
that if X is a beta random variable with parameters a and b, then 
a 


Od arora 


ab 
(a+ b)(a + b + 1) 


Var(X) = 


Remark. A verification of Equation (6.3) appears in Example 7c of Chapter 6. 


5.7. THE DISTRIBUTION OF A FUNCTION OF A RANDOM VARIABLE 


Often, we know the probability distribution of a random variable and are interested 
in determining the distribution of some function of it. For instance, suppose that we 
know the distribution of XY and want to find the distribution of g(X). To do so, it is 
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necessary to express the event that g(X) = y in terms of X being in some set. We 
illustrate with the following examples. 


EXAMPLE 7a 
Let X be uniformly distributed over (0, 1). We obtain the distribution of the random 


variable Y, defined by Y = X”, as follows: For 0 = y = 1, 
Fy(y) = P{Y = y} 
= P(X" = y} 
ahx ey") 


dl 24 
yal (= yet 

fro=4n 4 | 
0 otherwise 


EXAMPLE 7b 
If X is a continuous random variable with probability density fy, then the distribution 
of Y = X? is obtained as follows: For y = 0, 
Fy(y) = P{Y = y} 
=P = y} 
=Pi-yy = XS yy) 
= Pyeti/y) — Fxt—/) 


Differentiation yields 


1 
fy) = Zp xy) +fx(—./¥)] a 
EXAMPLE 7c 


If X has a probability density fy, then Y = |X| has a density function that is obtained 
as follows: For y = 0, 


Fy(y)=P{Y Sy} 
= P{|X| = y} 
Sys 2S) 
= Fy(y) — Fx(—y) 


Hence, on differentiation, we obtain 


fy) =fxQ) + fx(-y) y=0 
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The method employed in Examples 7a through 7c can be used to prove 
Theorem 7.1. 


Theorem 7.1. Let X be a continuous random variable having probability density func- 
tion fx. Suppose that g(x) is a strictly monotonic (increasing or decreasing), differen- 
tiable (and thus continuous) function of x. Then the random variable Y defined by 
Y = g(X) has a probability density function given by 


d 
fxlg!o)] Feo] if y = g(x) for some x 
fro) = dy 


0 ify # g(x) forall x 


where g~!(y) is defined to equal that value of x such that g(x) = y. 
We shall prove Theorem 7.1 when g(x) is an increasing function. 


Proof. Suppose that y = g(x) for some x. Then, with Y = g(X), 
Fy(y) = Pig(X) = yl 
=P{X = g'(y)} 
= Fx(g"*(y)) 
Differentiation gives 
fr) = fee O10) a 


which agrees with Theorem 7.1, since g~!(y) is nondecreasing, so its derivative is non- 
negative. 
When y # g(x) for any x, then Fy(y) is either 0 or 1, and in either case fy(y) = 0. 


EXAMPLE 7d 


Let X be a continuous nonnegative random variable with density function f, and let 
Y = X". Find fy, the probability density function of Y. 


Solution. If g(x) = x", then 


gly) = yi 
and 
d_ 1 _ 
ae Oey 
ly n 


Hence, from Theorem 7.1, we obtain 


1 
Fr) =~ "Fo"") 
For n = 2, this gives 


1 2 
fro= Tl VY 


which (since X¥ = 0) is in agreement with the result of Example 7b. | 
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SUMMARY 


A random variable X is continuous if there is a nonnegative function f, called the 
probability density function of X, such that, for any set B, 


P{xXx € By= / f(x) dx 
B 
If_X is continuous, then its distribution function F will be differentiable and 


£ Fo) = f(x) 


The expected value of a continuous random variable X is defined by 


E[|X] = [- xf (x) dx 


A useful identity is that, for any function g, 


E[e(X)] = / ax)f (x) dx 


As in the case of a discrete random variable, the variance of X is defined by 
Var(X) = E[(X — E[X])7] 


A random variable X is said to be uniform over the interval (a, b) if its probability 
density function is given by 


1 
a <x<=b 
feo=tb—-a * * 
0 otherwise 
Its expected value and variance are 
a+b (b — a)? 


E[|X]= 5 Var(X) = D 


A random variable X is said to be normal with parameters jz and o7 if its probability 
density function is given by 


f@= yal —o.<x <o 
It can be shown that 

w= EX] 07 = Var(X) 
If X is normal with mean wp and variance o7, then Z, defined by 
a liet 


oO 


Z= 


is normal with mean 0 and variance 1. Such a random variable is said to be a standard 
normal random variable. Probabilities about X can be expressed in terms of proba- 
bilities about the standard normal variable Z, whose probability distribution function 
can be obtained either from Table 5.1 or from a website. 
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When n is large, the probability distribution function of a binomial random vari- 
able with parameters n and p can be approximated by that of a normal random 
variable having mean mp and variance np(1 — p). 

A random variable whose probability density function is of the form 


rpe** x =O 
fQ)= | 0 otherwise 


is said to be an exponential random variable with parameter i. Its expected value and 
variance are, respectively, 


1 1 


A key property possessed only by exponential random variables is that they are mem- 
oryless, in the sense that, for positive s and f, 


PIX >st+t\X > th=P{X > s} 


If X represents the life of an item, then the memoryless property states that, for any 
t, the remaining life of a ¢-year-old item has the same probability distribution as the 
life of a new item. Thus, one need not remember the age of an item to know its 
distribution of remaining life. 

Let X be a nonnegative continuous random variable with distribution function F 
and density function f. The function 


fO 
n= 
) 1 - FY 
is called the hazard rate, or failure rate, function of F. If we interpret X as being the 
life of an item, then, for small values of dt, A(t) dt is approximately the probability 
that a f-unit-old item will fail within an additional time dr. If F is the exponential 
distribution with parameter A, then 


AH=r tzZO 


In addition, the exponential is the unique distribution having a constant failure rate. 
A random variable is said to have a gamma distribution with parameters a and i 
if its probability density function is equal to 


re *(ax)2-1 


PQ) = ay x= 


=) 


and is 0 otherwise. The quantity '(@) is called the gamma function and is defined by 
loe) 
l(a) = / ere de 
0 
The expected value and variance of a gamma random variable are, respectively, 


E[X] => Var(X) = a 


224 Chapter 5 Continuous Random Variables 


A random variable is said to have a beta distribution with parameters (a, b) if its 


probability density function is equal to 


O<x<1 


yal (1 = x1 


fa) = Ba,b) 


and is equal to 0 otherwise. The constant B(a, b) is given by 
1 
Bia, b) = / x2-1q = xy! dx 
0 


The mean and variance of such a random variable are, respectively, 


a ab 


BAT= 6 MO" Ge ra +b + 


PROBLEMS 
5.1. Let X be a random variable with probability den- 10 
sity function f= 2 x > 10 
P 0 x =10 
ei -lex<l 
0 otherwise (a) Find P(X > 20}. 


5.2. 


5.3. 


5.4. 


(a) What is the value of c? 

(b) What is the cumulative distribution function 
of X? 

A system consisting of one original unit plus a 

spare can function for a random amount of time X. 

If the density of X is given (in units of months) by 


aa x >0 


what is the probability that the system functions 
for at least 5 months? 


Consider the function 


C(2x — x3) O<x<3 
iOy= ( otherwise 
Could f be a probability density function? If so, 
determine C. Repeat if f(x) were given by 


= C(2x — x?) O<x=<3 
cs ( otherwise 


The probability density function of X, the lifetime 
of a certain type of electronic device (measured in 
hours), is given by 


5.5. 


5.6. 


What is the cumulative distribution function 
of X? 

(c) What is the probability that, of 6 such types of 
devices, at least 3 will function for at least 15 
hours? What assumptions are you making? 


(b) 


A filling station is supplied with gasoline once a 
week. If its weekly volume of sales in thousands of 
gallons is a random variable with probability den- 
sity function 


_ 4 
f@) = i » 


what must the capacity of the tank be so that the 
probability of the supply’s being exhausted in a 
given week is .01? 


O<x <1 
otherwise 


Compute E[X] if X has a density function given by 
ye? gs 6 
(a) f= 4 : 
0 otherwise 
_ Jed = 2) -l<x<1, 
hy f= f otherwise 
a 5 
>= x> 
(c) f@) = 4x 
0 «x s5 


5.7. 


5.8. 


5.9. 


5.10. 


5.11. 


5.12. 


5.13. 


The density function of X is given by 
|e aer C2721 
fae ( otherwise 


If E[X] = 3, find a and b. 


The lifetime in hours of an electronic tube is a ran- 
dom variable having a probability density function 
given by 

x=0 


f(x) =xe~* 


Compute the expected lifetime of such a tube. 


Consider Example 4b of Chapter 4, but now sup- 
pose that the seasonal demand is a continuous ran- 
dom variable having probability density function f. 
Show that the optimal amount to stock is the value 
s* that satisfies 


b 
F(s*) = —— 
oe b+ 2£ 
where b is net profit per unit sale, ¢ is the net loss 
per unit unsold, and F is the cumulative distribu- 
tion function of the seasonal demand. 


Trains headed for destination A arrive at the train 

station at 15-minute intervals starting at 7 A.M., 

whereas trains headed for destination B arrive at 

15-minute intervals starting at 7:05 A.M. 

(a) Ifacertain passenger arrives at the station at 
a time uniformly distributed between 7 and 
8 A.M. and then gets on the first train that 
arrives, what proportion of time does he or 
she go to destination A? 

(b) What if the passenger arrives at a time uni- 
formly distributed between 7:10 and 8:10 
A.M.? 


A point is chosen at random on a line segment 
of length L. Interpret this statement, and find the 
probability that the ratio of the shorter to the 
longer segment is less than I 


A bus travels between the two cities A and B, 
which are 100 miles apart. If the bus has a break- 
down, the distance from the breakdown to city A 
has a uniform distribution over (0, 100). There is a 
bus service station in city A, in B, and in the cen- 
ter of the route between A and B. It is suggested 
that it would be more efficient to have the three 
stations located 25, 50, and 75 miles, respectively, 
from A. Do you agree? Why? 


You arrive at a bus stop at 10 o’clock, knowing 

that the bus will arrive at some time uniformly dis- 

tributed between 10 and 10:30. 

(a) What is the probability that you will have to 
wait longer than 10 minutes? 


5.14. 


5.15. 


5.16. 


5.17. 


5.18. 


5.19. 


5.20. 
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(b) If, at 10:15, the bus has not yet arrived, what 
is the probability that you will have to wait at 
least an additional 10 minutes? 


Let X be a uniform (0, 1) random variable. Com- 
pute E[X”] by using Proposition 2.1, and then 
check the result by using the definition of expec- 
tation. 


If X is a normal random variable with parameters 
uu = 10 and o? = 36, compute 

(a) P{X > 5}; 

(b) P{4 < X < 16}; 

(c) P{X < 8}; 

(d) P{X < 20}; 

(e) P{X > 16}. 


The annual rainfall (in inches) in a certain region is 
normally distributed with w = 40 and o = 4. What 
is the probability that, starting with this year, it will 
take over 10 years before a year occurs having a 
rainfall of over 50 inches? What assumptions are 
you making? 


A man aiming at a target receives 10 points if his 
shot is within 1 inch of the target, 5 points if it is 
between | and 3 inches of the target, and 3 points if 
it is between 3 and 5 inches of the target. Find the 
expected number of points scored if the distance 
from the shot to the target is uniformly distributed 
between 0 and 10. 


Suppose that X is a normal random variable with 
mean 5. If P{X > 9} = .2, approximately what is 
Var(X)? 


Let X be a normal random variable with mean 
12 and variance 4. Find the value of c such that 
P{X > c}=.10. 


If 65 percent of the population of a large commu- 
nity is in favor of a proposed rise in school taxes, 
approximate the probability that a random sample 
of 100 people will contain 

(a) at least 50 who are in favor of the proposition; 
(b) between 60 and 70 inclusive who are in favor; 
(c) fewer than 75 in favor. 


Suppose that the height, in inches, of a 25-year-old 
man is a normal random variable with parameters 
yw = 71 and o? = 6.25. What percentage of 25- 
year-old men are over 6 feet, 2 inches tall? What 
percentage of men in the 6-footer club are over 6 
feet, 5 inches? 


The width of a slot of a duralumin forging is (in 

inches) normally distributed with «4 = .9000 and 

o = .0030. The specification limits were given as 

.9000 + .0050. 

(a) What percentage of forgings will be defec- 
tive? 
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(b) What is the maximum allowable value of o 
that will permit no more than 1 in 100 defec- 
tives when the widths are normally distributed 
with 4. = .9000 and a? 
One thousand independent rolls of a fair die will 
be made. Compute an approximation to the prob- 
ability that the number 6 will appear between 150 
and 200 times inclusively. If the number 6 appears 
exactly 200 times, find the probability that the 
number 5 will appear less than 150 times. 
The lifetimes of interactive computer chips pro- 
duced by a certain semiconductor manufacturer 
are normally distributed with parameters uw = 
1.4 X 10° hours and o = 3 X 10° hours. What is the 
approximate probability that a batch of 100 chips 
will contain at least 20 whose lifetimes are less than 
1.8 * 10°? 
Each item produced by a certain manufacturer is, 
independently, of acceptable quality with proba- 
bility .95. Approximate the probability that at most 
10 of the next 150 items produced are unaccept- 
able. 
Two types of coins are produced at a factory: a fair 
coin and a biased one that comes up heads 55 per- 
cent of the time. We have one of these coins, but 
do not know whether it is a fair coin or a biased 
one. In order to ascertain which type of coin we 
have, we shall perform the following statistical test: 
We shall toss the coin 1000 times. If the coin lands 
on heads 525 or more times, then we shall conclude 
that it is a biased coin, whereas if it lands on heads 
less than 525 times, then we shall conclude that it 
is a fair coin. If the coin is actually fair, what is the 
probability that we shall reach a false conclusion? 
What would it be if the coin were biased? 
In 10,000 independent tosses of a coin, the coin 
landed on heads 5800 times. Is it reasonable to 
assume that the coin is not fair? Explain. 
Twelve percent of the population is left handed. 
Approximate the probability that there are at least 
20 left-handers in a school of 200 students. State 
your assumptions. 
A model for the movement of a stock supposes 
that if the present price of the stock is s, then, after 
one period, it will be either us with probability p 
or ds with probability 1 — p. Assuming that suc- 
cessive movements are independent, approximate 
the probability that the stock’s price will be up 
at least 30 percent after the next 1000 periods if 
u = 1.012,d = 0.990, and p = .52. 
An image is partitioned into two regions, one 
white and the other black. A reading taken from 
a randomly chosen point in the white section will 
give a reading that is normally distributed with wu = 
4 and o? = 4, whereas one taken from a randomly 
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5.32. 


5.33. 


5.34. 


5.35. 


chosen point in the black region will have a nor- 

mally distributed reading with parameters (6, 9). 

A point is randomly chosen on the image and has 

a reading of 5. If the fraction of the image that is 

black is a, for what value of a would the probabil- 

ity of making an error be the same, regardless of 
whether one concluded that the point was in the 
black region or in the white region? 

(a) A fire station is to be located along a road of 
length A,A < oo. If fires occur at points uni- 
formly chosen on (0, A), where should the sta- 
tion be located so as to minimize the expected 
distance from the fire? That is, choose a so 
as to 

minimize E[|X — al] 


when X is uniformly distributed over (0, A). 

(b) Now suppose that the road is of infinite 
length—stretching from point 0 outward to oo. 
If the distance of a fire from point 0 is expo- 
nentially distributed with rate 4, where should 
the fire station now be located? That is, we 
want to minimize E||X — al], where X is now 
exponential with rate i. 

The time (in hours) required to repair a machine is 

an exponentially distributed random variable with 

parameter A = i. What is 

(a) the probability that a repair time exceeds 2 
hours? 

(b) the conditional probability that a repair takes 
at least 10 hours, given that its duration 
exceeds 9 hours? 

The number of years a radio functions is exponen- 

tially distributed with parameter A = ? If Jones 

buys a used radio, what is the probability that it 
will be working after an additional 8 years? 

Jones figures that the total number of thousands 

of miles that an auto can be driven before it would 

need to be junked is an exponential random vari- 
able with parameter x0 Smith has a used car that 
he claims has been driven only 10,000 miles. If 

Jones purchases the car, what is the probability 

that she would get at least 20,000 additional miles 

out of it? Repeat under the assumption that the 
lifetime mileage of the car is not exponentially dis- 
tributed, but rather is (in thousands of miles) uni- 

formly distributed over (0, 40). 

The lung cancer hazard rate A(¢) of a t-year-old 

male smoker is such that 
A(t) = .027 + .00025(t — 40)* += 40 

Assuming that a 40-year-old male smoker survives 

all other hazards, what is the probability that he 

survives to (a) age 50 and (b) age 60 without con- 
tracting lung cancer? 
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5.3. 


5.4. 


Suppose that the life distribution of an item has the 
hazard rate function A(t) = f,t > 0. What is the 
probability that 

(a) the item survives to age 2? 

(b) the item’s lifetime is between .4 and 1.4? 

(c) a 1-year-old item will survive to age 2? 


If X is uniformly distributed over (—1, 1), find 

(a) P{\X| > 3}; 

(b) the density function of the random variable 
|X. 


If Y is uniformly distributed over (0, 5), what 
is the probability that the roots of the equation 
4x? + 4xY + Y + 2 =Oare both real? 


5.39. 


5.40. 


5.41. 
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If X is an exponential random variable with 
parameter 4 = 1, compute the probability den- 
sity function of the random variable Y defined by 
Y=logX. 

If X is uniformly distributed over (0, 1), find the 
density function of Y = e*. 

Find the distribution of R = Asin#@, where A is 
a fixed constant and @ is uniformly distributed on 
(—2/2,2/2). Such a random variable R arises in 
the theory of ballistics. If a projectile is fired from 
the origin at an angle w from the earth with a speed 
v, then the point R at which it returns to the earth 
can be expressed as R = (v?/g) sin2a, where g is 
the gravitational constant, equal to 980 centime- 
ters per second squared. 


THEORETICAL EXERCISES 


The speed of a molecule in a uniform gas at equi- 
librium is a random variable whose probability 
density function is given by 


2 
bx y =O 


x <0 


pare [0 


where b = m/2kT and k, T, and m denote, respec- 
tively, Boltzmann’s constant, the absolute temper- 
ature of the gas, and the mass of the molecule. 
Evaluate a in terms of b. 


Show that 

EY|= [ P{Y > y}dy — / P{Y < -y}dy 
0 0 

Hint: Show that 


co 0 
[ P{Y < -y}dy= -{ xfy (x) dx 
0 ioe) 


[ P{Y > y}dy= / xfy (x) dx 
0 0 
Show that if X has density function f, then 


Ele(X)] = i a(x)fcx) dx 


Hint: Using Theoretical Exercise 2, start with 


5.5. 


5.6. 


5.7. 


5.8. 


Ele(X)] = [ Pig) > yidy — i Pig(X) <—y} dy 


and then proceed as in the proof given in the text 
when g(X) = 0. 


Prove Corollary 2.1. 


Use the result that, for a nonnegative random vari- 
able Y, 


Ety|= f° Pv > tdt 
0 


to show that, for a nonnegative random vari- 
able X, 
co 
E[X"] = [ nx"|PLX > x}dx 
0 
Hint: Start with 


E[X") = [ * Pex" > fdt 


and make the change of variables t = x”. 
Define a collection of events Eyz,0 < a < 1, hav- 
ing the property that P(E,) = 1 for all a but 


P(Q) Eq) =0. 
a 


Hint: Let X be uniform over (0, 1) and define each 
Eq in terms of X. 
The standard deviation of X, denoted SD(X), is 


given by 
SD(X) = /Var(X) 


Find SD(aX + b) if X has variance o?. 
Let X be a random variable that takes on values 
between 0 and c. That is, P(O = X = c} = 1. 


Show that 
2 


(os 
Var(X) = — 
ar(X’) ri 


Hint: One approach is to first argue that 


E[X?] = cE[X] 
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5.9. 


5.10. 


5.11. 


5.12. 


5.13. 


5.14. 


5.15. 


5.16. 


5.17. 


5.18. 


5.19. 
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and then use this inequality to show that 


E|X] 


Var(X) = [a1 —a)] wherea= 


Show that Z is a standard normal random variable, 
then, for x > 0, 

(a) P{Z > x}=P{Z < —x}; 

(b) P{|Z| > x} =2P{Z > x}; 

(c) P{|Z| < x} =2P{Z < x} — 1. 

Let f(x) denote the probability density function of 
a normal random variable with mean yp and vari- 
ance o”. Show that zp — o and « + o are points 
of inflection of this function. That is, show that 
f"(*) =Owhenx =p —- ocorx=p+to. 

Let Z be a standard normal random variable Z, 
and let g be a differentiable function with deriva- 
tive g’. 

(a) Show that 
(b) Show that 
(c) Find E[Z*]. 
Use the identity of Theoretical Exercise 5 to derive 
E[X?] when_X is an exponential random variable 
with parameter i. 

The median of a continuous random variable hav- 
ing distribution function F is that value m such that 
F(m) = 5. That is, a random variable is just as 
likely to be larger than its median as it is to be 
smaller. Find the median of X if X is 

(a) uniformly distributed over (a, b); 

(b) normal with parameters p, o?; 

(c) exponential with rate A. 

The mode of a continuous random variable having 
density f is the value of x for which f(x) attains its 
maximum. Compute the mode of X in cases (a), 
(b), and (c) of Theoretical Exercise 5.13. 

If X is an exponential random variable with 
parameter A, andc > 0, show that cX is exponen- 
tial with parameter A/c. 

Compute the hazard rate function of X when X is 
uniformly distributed over (0, a). 

If X has hazard rate function 4 (ft), compute the 
hazard rate function of aX where a is a positive 
constant. 

Verify that the gamma density function integrates 
to 1. 


Elg'(Z)] = E[Zg(Z)] 
E[Z")] = nE[Z" 1] 


If X is an exponential random variable with mean 
1/4, show that 
: k! 
E[X*] = se KSLA 


Hint: Make use of the gamma density function to 
evaluate the preceding. 
Verify that 


Var(X) = a 


5.21. 


5.22. 


5.23. 


5.24, 


5.25. 


5.26. 


5.27. 


5.28. 


5.29. 


5.30. 


when X is a gamma random variable with param- 
eters a and i. 


Show that T (3) =/n. 
Hint: (+) = fy e*x1/? dx. Make the change 


of variables y = ¥2x and then relate the resulting 
expression to the normal distribution. 


Compute the hazard rate function of a gamma ran- 
dom variable with parameters (a, A) and show it is 
increasing when a = 1 and decreasing when a = 1. 


Compute the hazard rate function of a Weibull 
random variable and show it is increasing when 
B = 1 and decreasing when 6 = 1. 


Show that a plot of log(log(1 — F(x))~') against 
log x will be a straight line with slope 6 when 
F(-) is a Weibull distribution function. Show also 
that approximately 63.2 percent of all observa- 
tions from such a distribution will be less than a. 
Assume that v = 0. 


Let 
(=) 
Y — 
a 
Show that if X is a Weibull random variable with 
parameters v,a, and #, then Y is an exponential 


random variable with parameter 4 = 1 and vice 
versa. 


If X is a beta random variable with parameters a 
and b, show that 
a 
E[X] = 
IX] a+b 
ab 
Var(X) = 


(a+ b2(a +b+ 1) 


If X is uniformly distributed over (a, b), what ran- 
dom variable, having a linear relation with X, is 
uniformly distributed over (0, 1)? 


Consider the beta distribution with parameters 
(a, b). Show that 

(a) when a > 1 and b > 1, the density is uni- 
modal (that is, it has a unique mode) with 
mode equal to (a — 1)/(a + b — 2); 
whena = 1,b = l,anda+ b < 2, the den- 
sity is either unimodal with mode at 0 or 1 or 
U-shaped with modes at both 0 and 1; 

(c) when a = 1 = 5, all points in [0, 1] are modes. 


(b) 


Let X be a continuous random variable having 
cumulative distribution function F. Define the ran- 
dom variable Y by Y = F(X). Show that Y is 
uniformly distributed over (0, 1). 

Let X have probability density fy. Find the prob- 


ability density function of the random variable Y 
defined by Y= aX + b. 


5.31. 


5.32. 


5.1. 


.050 


.025 


5.2. 


Find the probability density function of Y = e* 
when X is normally distributed with parameters pu 
and o?. The random variable Y is said to have a 
lognormal distribution (since log Y has a normal 
distribution) with parameters yz and o?. 

Let X and Y be independent random vari- 

ables that are both equally likely to be either 

1,2,...,(10)", where N is very large. Let D denote 

the greatest common divisor of X and Y, and let 

QO, = P{D =k}. 

(a) Give a heuristic argument that OQ; = bO1. 
Hint: Note that in order for D to equal k, k 
must divide both X and Y and also X/k, and 
Y/k must be relatively prime. (That is, X/k, 
and Y/k must have a greatest common divisor 
equal to 1.) 


(b) Use part (a) to show that 


Q; = P{X and ¥ are relatively prime} 
1 


+s ie 
k=1 
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It is a well-known identity that )°1/k* = 
1 


m?/6, so Q, = 6/2”. (In number theory, this 
is known as the Legendre theorem.) 
(c) Now argue that 


where P; is the ith-smallest prime greater 
than 1. 

Hint: X and Y will be relatively prime if they 
have no common prime factors. Hence, from 
part (b), we see that 


i=1 


which was noted without explanation in 
Problem 11 of Chapter 4. (The relationship 
between this problem and Problem 11 of 
Chapter 4 is that X and Y are relatively prime 
if XY has no multiple prime factors.) 


5.33. Prove Theorem 7.1 when g(x) is a decreasing func- 


tion. 


SELF-TEST PROBLEMS AND EXERCISES 


The number of minutes of playing time of a certain 
high school basketball player in a randomly cho- 
sen game is a random variable whose probability 
density function is given in the following figure: 


10 20 30 40 


Find the probability that the player plays 

(a) over 15 minutes; 

(b) between 20 and 35 minutes; 

(c) less than 30 minutes; 

(d) more than 36 minutes. 

For some constant c, the random variable X has 
the probability density function 


cx” 0-2 x = 1 
f@) = 0 otherwise 


Find (a) c and (b) P{X¥ > x},0 < x < 1. 


5.3. 


5.4. 


5.5. 


For some constant c, the random variable XY has 
the probability density function 


cx*# O<x <2 


i= | 0 otherwise 


Find (a) ELX] and (b) Var(X). 


The random variable X has the probability density 
function 
_ | Sa Be Oe woe 
1ey= | 0 otherwise 


If ELX] = .6, find (a) P(X < 4} and (b) Var(X). 


The random variable X is said to be a discrete uni- 
form random variable on the integers 1,2,...,n if 
- ft , 
P{X =i}=—- i=1,2,...,n 
n 


For any nonnegative real number x, let Int(x) 
(sometimes written as [x]) be the largest inte- 
ger that is less than or equal to x. Show that 
U is a uniform random variable on (0, 1), fain 
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5.6. 


5.7. 


5.8. 


5.9. 


5.10. 


5.11. 
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X = Int(nU) + 1 is a discrete uniform random 
variable on 1,...,7. 

Your company must make a sealed bid for a con- 

struction project. If you succeed in winning the 

contract (by having the lowest bid), then you plan 
to pay another firm 100 thousand dollars to do 
the work. If you believe that the minimum bid 

(in thousands of dollars) of the other participating 

companies can be modeled as the value of a ran- 

dom variable that is uniformly distributed on (70, 

140), how much should you bid to maximize your 

expected profit? 

To be a winner in a certain game, you must be 

successful in three successive rounds. The game 

depends on the value of U, a uniform random vari- 
able on (0, 1). If U > .1, then you are successful 
in round 1; if U > .2, then you are successful in 
round 2; andif U > .3, then you are successful in 

round 3. 

(a) Find the probability that you are successful in 
round 1. 

(b) Find the conditional probability that you are 
successful in round 2 given that you were suc- 
cessful in round 1. 

(c) Find the conditional probability that you are 
successful in round 3 given that you were suc- 
cessful in rounds 1 and 2. 

(d) Find the probability that you are a winner. 

A randomly chosen IQ test taker obtains a score 

that is approximately a normal random variable 

with mean 100 and standard deviation 15. What is 
the probability that the score of such a person is 

(a) above 125; (b) between 90 and 110? 

Suppose that the travel time from your home to 

your office is normally distributed with mean 40 

minutes and standard deviation 7 minutes. If you 

want to be 95 percent certain that you will not be 
late for an office appointment at 1 P.M., what is the 
latest time that you should leave home? 

The life of a certain type of automobile tire is nor- 

mally distributed with mean 34,000 miles and stan- 

dard deviation 4000 miles. 

(a) What is the probability that such a tire lasts 
over 40,000 miles? 

(b) What is the probability that it lasts between 
30,000 and 35,000 miles? 

(c) Given that it has survived 30,000 miles, what 
is the conditional probability that the tire sur- 
vives another 10,000 miles? 

The annual rainfall in Cleveland, Ohio is approx- 

imately a normal random variable with mean 40.2 

inches and standard deviation 8.4 inches. What is 

the probability that 

(a) next year’s rainfall will exceed 44 inches? 

(b) the yearly rainfalls in exactly 3 of the next 7 
years will exceed 44 inches? 


5.12. 


5.13. 


5.14. 


5.15. 


5.16. 


Assume that if A; is the event that the rainfall 
exceeds 44 inches in year i (from now), then the 
events Aj,i = 1, are independent. 

The following table uses 1992 data concerning the 
percentages of male and female full-time workers 
whose annual salaries fall into different ranges: 


Earnings range Percentage Percentage 
of females of males 
=9999 8.6 4.4 
10,000-19,999 38.0 21.1 
20,000-24,999 19.4 15.8 
25,000-49,999 29.2 41.5 
=50,000 4.8 17.2 


Suppose that random samples of 200 male and 200 
female full-time workers are chosen. Approximate 
the probability that 
(a) atleast 70 of the women earn $25,000 or more; 
(b) at most 60 percent of the men earn $25,000 

or more; 
(c) at least three-fourths of the men and at least 
half the women earn $20,000 or more. 
At a certain bank, the amount of time that a cus- 
tomer spends being served by a teller is an expo- 
nential random variable with mean 5 minutes. If 
there is a customer in service when you enter the 
bank, what is the probability that he or she will still 
be with the teller after an additional 4 minutes? 
Suppose that the cumulative distribution function 
of the random variable X is given by 

2 


Fax) =1-—e* x>0 

Evaluate (a) P{X > 2}; (b) P{1 < X < 3}; (c) the 
hazard rate function of F; (d) ELX]; (e) Var(X). 
Hint: For parts (d) and (e), you might want to 
make use of the results of Theoretical Exercise 5. 
The number of years that a washing machine func- 
tions is a random variable whose hazard rate func- 
tion is given by 


2 0O<t<2 
ADM=4 24+ 3¢-2) 25t<5 
1A t>5 


(a) What is the probability that the machine will 
still be working 6 years after being purchased? 

(b) If it is still working 6 years after being pur- 
chased, what is the conditional probability 
that it will fail within the next 2 years? 

A standard Cauchy random variable has density 

function 


1 


$= Tae) 


-—-wo<xX < © 


5.17. 


5.18. 


5.19. 


Show that X is a standard Cauchy random 
variable, then 1/X is also a standard Cauchy ran- 
dom variable. 

A roulette wheel has 38 slots, numbered 0, 00, and 
1 through 36. If you bet 1 on a specified num- 
ber then you either win 35 if the roulette ball 
lands on that number or lose 1 if it does not. 
If you continually make such bets, approximate 
the probability that 

(a) you are winning after 34 bets; 

(b) you are winning after 1000 bets; 

(c) you are winning after 100,000 bets. 

Assume that each roll of the roulette ball is equally 
likely to land on any of the 38 numbers. 

There are two types of batteries in a bin. When in 
use, type i batteries last (in hours) an exponentially 
distributed time with rate A;,i = 1,2. A battery 
that is randomly chosen from we bin will be a type 


i battery with probability p;, 3 pi = 1. If a ran- 


domly chosen battery is still aperating after ¢ hours 
of use, what is the probability that it will still be 
operating after an additional s hours? 

Evidence concerning the guilt or innocence of a 
defendant in a criminal investigation can be sum- 
marized by the value of an exponential random 
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variable X whose mean yz depends on whether the 

defendant is guilty. If innocent, ~ = 1; if guilty, 

je = 2. The deciding judge will rule the defen- 
dant guilty if X > c for some suitably chosen 

value of c. 

(a) If the judge wants to be 95 percent certain 
that an innocent man will not be convicted, 
what should be the value of c? 

(b) Using the value of c found in part (a), what is 
the probability that a guilty defendant will be 
convicted? 


5.20. For any real number y, define yt by 


+_y, ify=0 
¥ = 0, ify <0 
Let c be a constant. 
(a) Show that 
E((Z — o)*]= 1 ep c(1 — ®(c)) 
V 20 


when Z is a standard normal random variable. 


(b) Find E[(X — c)t] when X is normal with 


mean ju and variance o?. 
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JOINT DISTRIBUTION FUNCTIONS 

INDEPENDENT RANDOM VARIABLES 

SUMS OF INDEPENDENT RANDOM VARIABLES 

CONDITIONAL DISTRIBUTIONS: DISCRETE CASE 

CONDITIONAL DISTRIBUTIONS: CONTINUOUS CASE 

ORDER STATISTICS 

JOINT PROBABILITY DISTRIBUTION OF FUNCTIONS OF RANDOM VARIABLES 
EXCHANGEABLE RANDOM VARIABLES 


JOINT DISTRIBUTION FUNCTIONS 


Thus far, we have concerned ourselves only with probability distributions for single 
random variables. However, we are often interested in probability statements con- 
cerning two or more random variables. In order to deal with such probabilities, we 
define, for any two random variables X and Y, the joint cumulative probability distri- 
bution function of X and Y by 


Fia,b)=P{X =a,Y Sb} -w<ab<a 


The distribution of X can be obtained from the joint distribution of X and Y as 
follows: 


Fy(a) = P{X = a} 
=P{X =a,Y < ow} 
=F lim {X¥ <a,Y S 0) 
boo 

= lim P{X¥ =a,Y = b} 
boo 

= lim Fca,b) 
boo 

= F(a,o) 


Note that, in the preceding set of equalities, we have once again made use of the fact 
that probability is a continuous set (that is, event) function. Similarly, the cumulative 
distribution function of Y is given by 


Fy(b) = P{Y < b} 
= lim F(a,b) 
ao 


= F(~,b) 


Section 6.1 Joint Distribution Functions 233 


The distribution functions Fy and Fy are sometimes referred to as the marginal dis- 
tributions of X and Y. 

All joint probability statements about X and Y can, in theory, be answered in terms 
of their joint distribution function. For instance, suppose we wanted to compute the 
joint probability that X is greater than a and Y is greater than b. This could be done 
as follows: 

P{LX > a,Y > b}=1 — PUX > a,Y > bd} 

=1 — P({X > a}S U{Y > D}) 

=1—-— PUX Sa} U{Y = Db) (1.1) 

=1 — [P{X Sa} + P{Y sb} — P{x Sa,Y S D}] 

=1-— Fr(a) — Fy(o) + F@,b) 
Equation (1.1) is a special case of the following equation, whose verification is left as 
an exercise: 

Pla, < XS a, by <Ys bo} 
= F(a2,b2) + F(a,b1) — F(a1,b2) — F(a, 61) (1.2) 

whenever a, < a,b, < bo. 


In the case when_X and Y are both discrete random variables, it is convenient to 
define the joint probability mass function of X and Y by 


p(x,y) = P{X =x,Y=y} 


The probability mass function of X can be obtained from p(x, y) by 
Px(x) = P(X = x} 


= DO pty) 


yp (x,y)>0 
Similarly, 
pyyy= D> py) 
xip(x,y)>0 
EXAMPLE la 


Suppose that 3 balls are randomly selected from an urn containing 3 red, 4 white, and 
5 blue balls. If we let XY and Y denote, respectively, the number of red and white balls 
chosen, then the joint probability mass function of X and Y, p(i,j) = P{X =i, Y = j}, 


is given by 
ran (3)/(8)=35 
roo=(1)(0)/(3) =a 

a) ae. 
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3 220 
\/(3)= 20 
3 220 
12\_ 18 
> ) = 350 
12 1 
3 =a 
12 12 
3 =a 
it 


These probabilities can most easily be expressed in tabular form, as in Table 6.1. The 
reader should note that the probability mass function of X is obtained by computing 
the row sums, whereas the probability mass function of Y is obtained by comput- 
ing the column sums. Because the individual probability mass functions of X and Y 
thus appear in the margin of such a table, they are often referred to as the marginal 
probability mass functions of X and Y, respectively. | 


TABLE 6.1: P{X = i, Y = j} 


J 
i 0 1 2 3 Row sum = P{X = i} 
: 10 40 30 4 84 
20 220 220 220 220 
' 30 60 18 108 
220 220 = 220 220 
15 12 27 
. 2m 2m ° ° 220 
1 1 
3 =. ¢ Gf =e 
220 220 
i oe 56 112 48 4 
Se ee 220 220 220 «220 


EXAMPLE 1b 


Suppose that 15 percent of the families in a certain community have no children, 20 
percent have 1 child, 35 percent have 2 children, and 30 percent have 3. Suppose 
further that in each family each child is equally likely (independently) to be a boy or 
a girl. If a family is chosen at random from this community, then B, the number of 
boys, and G, the number of girls, in this family will have the joint probability mass 


function shown in Table 6.2. 
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TABLE 6.2: P{B = i, G = j} 


j 
I 0 1 2 3 Row sum = P{B = i} 
0 5 10 .0875 .0375 3750 
1 10 175 1125 O 3875 
2, .0875 1125 0 0 .2000 
3 .0375 0 0 0 .0375 


Columnsum = P{G = j} 3750 3875 2000 = .0375 


The probabilities shown in Table 6.2 are obtained as follows: 
P{B = 0,G = 0} = P{no children} = .15 
P{B =0,G = 1} = P{1 girl and total of 1 child} 
= P{1 child}P{1 girl|1 child} = (.20) (5) 
P{B =0,G = 2} = P{2 girls and total of 2 children} 
= P{2 children}P{2 girls|2 children} = (.35) (:) 


We leave the verification of the remaining probabilities in the table to the reader. 


We say that X and Y are jointly continuous if there exists a function f(x, y), defined 
for all real x and y, having the property that, for every set C of pairs of real numbers 
(that is, C is a set in the two-dimensional plane), 


PUX,Y) € C= / f(x, y) dx dy (1.3) 
(x,y)EC 


The function f(x, y) is called the joint probability density function of X and Y. If A 
and B are any sets of real numbers, then, by defining C = {(x,y) : x € A,y € B}, we 
see from Equation (1.3) that 


puke Aye B)= ff fo.ydray (1.4) 
BJA 


Because 


F(a,b) = P{X € (—co, a], Y € (—c«, b]} 


b a 
=| / f(x, y) dx dy 


it follows, upon differentiation, that 
2 
da ob 


wherever the partial derivatives are defined. Another interpretation of the joint den- 
sity function, obtained from Equation (1.4), is 


f(a,b) = ——F(a,b) 


236 Chapter 6 


Jointly Distributed Random Variables 


d+db pa+da 
Pla<X <a+ dab <¥ <b + db)= f i f(x, y) dx dy 
b a 
=~ f(a,b) dadb 


when da and db are small and f(x, y) is continuous at a, b. Hence, f(a, b) is a measure 
of how likely it is that the random vector (X, Y) will be near (a, b). 

If X and Y are jointly continuous, they are individually continuous, and their prob- 
ability density functions can be obtained as follows: 


Pix € Ap= PO GAY ecco) 
=| [ foenaa 
A J—oo 
= / fx (x) dx 
A 


where 


fetx) = | f(x, y) dy 


is thus the probability density function of X. Similarly, the probability density func- 
tion of Y is given by 


fro) = / f(x, y) dx 


EXAMPLE Ic 
The joint density function of X and Y is given by 


_ \2e*e-Y 0 < x < 00, 0 < y < 00 
LO) = 3 otherwise 


Compute (a) P(X > 1,Y < 1}, (b) P{X¥ < Y}, and (c) P{X < a}. 


Solution. (a) 


1 poo 
P{X > 1,Y < 1} -| / 2e-*e~*” dx dy 
0 JI 


1 
= oe ae") a 
[ ( I) a4 

1 

= a md dy 
0 

= ed — e) 

(b) 


P{X < Y}= / / 2e*e~* dx dy 


(x,y):x<y 


co ry 
=i / 2e-*e~* dx dy 
0 0 
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Co 
-| 2271 = e ”)dy 
0 


CO [oe) 
= / 2e-Y%dy — / 2e~>" dy 
0 0 


se 
3 
1 
“3 
(c) 
a Co 
PIX < =| / 2e~*e-* dy dx 
0 JO 
a 
= e * dx 
0 
=1-e™" a 
EXAMPLE Id 


Consider a circle of radius R, and suppose that a point within the circle is randomly 
chosen in such a manner that all regions within the circle of equal area are equally 
likely to contain the point. (In other words, the point is uniformly distributed within 
the circle.) If we let the center of the circle denote the origin and define X and Y to be 
the coordinates of the point chosen (Figure 6.1), then, since (X, Y) is equally likely 
to be near each point in the circle, it follows that the joint density function of X and 
Y is given by 
c if? + y* = R? 


Xx, = 
roe 0 ifx? + y* > R? 


for some value of c. 


(a) Determine c. 
(b) Find the marginal density functions of X and Y. 


(c) Compute the probability that D, the distance from the origin of the point selected, 
is less than or equal to a. 


(d) Find E [D]. 


FIGURE 6.1: Joint probability distribution. 
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[- [/ fesnavar=1 


c i dydx =1 


x24 y2<R2 


Solution. (a) Because 


it follows that 


We can evaluate //\ +y2<R? dydx either by using polar coordinates or, 


more simply, by noting that it represents the area of the circle and is thus equal 
to 7 R*. Hence, 

_ oil 

WR 


(b) 


fics) = | f(x, y) dy 


1 
WR? Jx24y2<R? 


1 Cc 
= / dy, wherec= VR? — x? 


wR J_- 

Le eae ee 
a x =R 

IU 


and it equals 0 when x* > R*. By symmetry, the marginal density of Y is given by 


II 
a 
~ 
| 
Ne 
rs) 
MS 
iS) 
IA 
>.) 
ns) 


fry) 
=0 yak 


(c) The distribution function of D = /X2 + Y%, the distance from the origin, is 
obtained as follows: For0 = a S R, 


Fp(a) = P{V X2 + Y2 < a} 
= P(X? + Y* = a’} 


= i i eae 


x24 y2<q2 


1 
= Sa // dy dx 


x4 y2<q2 


R2 
where we have used the fact that i ‘fa ieee dy dx is the area of a circle of radius 
a and thus is equal to za’. 
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(d) From part (c), the density function of D is 
2a ee 
fo(@ = R O0O=a=R 
Hence, 
2. (* 2R 
E[D] = af a’da = — 
R? Jo 3 
EXAMPLE Ie 


The joint density of X and Y is given by 


e+”) 0 < x < 00, 0 < y < w 
fey) = 0 otherwise 


Find the density function of the random variable X/Y. 


Solution. We start by computing the distribution function of X/Y. Fora > 0, 


Y 


I/ ety) dx dy 


x/y=a 


oo pay 
= i | e °*Y) dx dy 
0 0 


[e,0) 
-| d —e )e*dy 
0 


(a+1 a 
—(at+l)y 
=> ey | . 
a+l1 
0 


al 
at+l 


x 
Fx y (a) =P{F = al 


= 1 = 


Differentiation shows that the density function of X/Y is given by fx;y(a) = 1/ 
(a + 137,0 = @ < oo, | 


We can also define joint probability distributions for n random variables in exactly 
the same manner as we did for n = 2. For instance, the joint cumulative probabil- 
ity distribution function F(a1,a2,...,a,) of the n random variables X1,X2,...,Xn 1s 
defined by 


F(ay, 42, Sg Mn) = PX, = a,X2 = a2, Tae Xn = ay} 
Further, the m random variables are said to be jointly continuous if there exists a 


function f(x1,x2,...,Xn), called the joint probability density function, such that, for 
any set C in n-space, 


P{(X, Xo,...,Xn) e C} = [fof for aimderdey ar, 
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In particular, for any 7 sets of real numbers Ay, A2,...,An, 


PU) © Ay Nove Ad Re Ags 


= / sae f(X1,.--5Xn) dxydx2---dxy 
n An-1 A, 


EXAMPLE If The multinomial distribution 


One of the most important joint distributions is the multinomial distribution, which 
arises when a sequence of n independent and identical experiments is performed. 
Suppose that each experiment can result in any one of r possible outcomes, with 


respective probabilities p;,p2,...,Pr, >. pi = 1. If we let X; denote the number of the 
i=1 
n experiments that result in outcome number /, then 
n! n 


PLX, = 14,Xo = No,...,Xp = ny} = ———p PP (1.5) 
ny!nz!---n,! 


; 
whenever )° nj =n. 


i=1 

Equation (1.5) is verified by noting that any sequence of outcomes for the 1 experi- 
ments that leads to outcome i occurring n; times fori = 1,2,...,r will, by the assumed 
independence of experiments, have probability Pp Ps ...p" of occurring. Because 
there are n!/(n,!ng!...n;!) such sequences of outcomes (there are n!/ny!...n,! dif- 
ferent permutations of n things of which n, are alike, nz are alike, ...,n,; are alike), 
Equation (1.5) is established. The joint distribution whose joint probability mass func- 
tion is specified by Equation (1.5) is called the multinomial distribution. Note that 
when r = 2, the multinomial reduces to the binomial distribution. 

Note also that any sum of a fixed set of the X/s will have a binomial distribution. 
That is, if N C {1,2,...,r}, then }¢;-, X; will be a binomial random variable with 
parameters n and p = )°j-xy pi. This follows because }°;-,, Xi represents the number 
of the n experiments whose outcome is in N, and each experiment will independently 
have such an outcome with probability }°j<y Di. 


As an application of the multinomial distribution, suppose that a fair die is rolled 
9 times. The probability that 1 appears three times, 2 and 3 twice each, 4 and 5 once 
each, and 6 not at all is 


9! 1 7iy fi si iy i a 9 i\? 
31212111110! (z) (=) (z) (=) (z) (z) ~ 31212! (z) a 


6.2 INDEPENDENT RANDOM VARIABLES 


The random variables X and Y are said to be independent if, for any two sets of real 
numbers A and B, 


P{X © A,Y € B} = P(X € A}PLY © B} (2.1) 


In other words, X and Y are independent if, for all A and B, the events E,4 = {X € A} 
and Fg = {Y € B} are independent. 

It can be shown by using the three axioms of probability that Equation (2.1) will 
follow if and only if, for all a, b, 


P(X =a,Y =b)=P{X = aP{Y = })} 
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Hence, in terms of the joint distribution function F of X and Y, X and Y are inde- 
pendent if 
Fca,b) = Fxy(a)Fy(b) for alla,b 


When X and Y are discrete random variables, the condition of independence (2.1) is 
equivalent to 


P(x,y) =px@)py(y) for all x,y (2.2) 


The equivalence follows because, if Equation (2.1) is satisfied, then we obtain Equa- 
tion (2.2) by letting A and B be, respectively, the one-point sets A = {x} and B = {y}. 
Furthermore, if Equation (2.2) is valid, then, for any sets A, B, 


P{X € A,Y eB} =~) py) 


yeBxeA 


=)0>opx@pro) 


yeBxeA 


= Do py) So px 


yeB xeEA 
= P{Y € B}P{X € A} 


and Equation (2.1) is established. 
In the jointly continuous case, the condition of independence is equivalent to 


fay) =fx@ fy) for all x,y 


Thus, loosely speaking, X and Y are independent if knowing the value of one does 
not change the distribution of the other. Random variables that are not independent 
are said to be dependent. 


EXAMPLE 2a 


Suppose that n + m independent trials having a common probability of success p are 
performed. If X is the number of successes in the first n trials, and Y is the number 
of successes in the final m trials, then X and Y are independent, since knowing the 
number of successes in the first 1 trials does not affect the distribution of the number 
of successes in the final m trials (by the assumption of independent trials). In fact, for 
integral x and y, 


IA IA 
3 


Pix=n¥=y=(7)era =p (™ pra = py ee 
= P(X = x}P{Y = y} 


In contrast, X and Z will be dependent, where Z is the total number of successes in 
the n + m trials. (Why?) | 


EXAMPLE 2b 


Suppose that the number of people who enter a post office on a given day is a Poisson 
random variable with parameter A. Show that if each person who enters the post office 
is a male with probability p and a female with probability 1 — p, then the number of 
males and females entering the post office are independent Poisson random variables 
with respective parameters Ap and A(1 — p). 
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Solution. Let X and Y denote, respectively, the number of males and females that 
enter the post office. We shall show the independence of X and Y by establishing 
Equation (2.2). To obtain an expression for P(X =i, Y = j}, we condition on ¥ + Y 
as follows: 


Pat Fag = Pea ie eae See 
+ PIX =i,YH=fJX + VY 4i+ PPX + V#i+z7 


[Note that this equation is merely a special case of the formula P(E) = P(E|F)P(F) + 
P(E|F°)P(F*).] 
Since P{X =i, Y =j|X + Y #i + j} is clearly 0, we obtain 


P{iX=iY=f=P(X=iY=j\X + V=sit+ pPixX+Y=i+sf (23) 


Now, because X + Y is the total number of people who enter the post office, it 
follows, by assumption, that 
ait 


PIX + Y=i+ j} =e*——_ 
aaa 


(2.4) 


Furthermore, given that i + j people do enter the post office, since each person 
entering will be male with probability p, it follows that the probability that exactly 
i of them will be male (and thus j of them female) is just the binomial probability 


@ a ‘) (1 — py. Thatis, 


PX =i =X + ¥=i4+=('F/ pia - py (2.5) 


Substituting Equations (2.4) and (2.5) into Equation (2.3) yields 


PLS =f= . . ‘)o a - pier 
=e? 7 “na — py 
= ray, -ai-p) ACL — py (2.6) 
i j 
Hence, 
P(X =i} = ew OP) a e7*-p) La — py = o- Opy (2.7) 
Pe ji il 
and similarly, 
PLY =p) =e*t-w AO = oP (2.8) 


j! 
Equations (2.6), (2.7), and (2.8) establish the desired result. a 
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EXAMPLE 2c 


A man and a woman decide to meet at a certain location. If each of them indepen- 
dently arrives at a time uniformly distributed between 12 noon and 1 P.M., find the 
probability that the first to arrive has to wait longer than 10 minutes. 


Solution. If we let X and Y denote, respectively, the time past 12 that the man and 
the woman arrive, then X and Y are independent random variables, each of which is 
uniformly distributed over (0, 60). The desired probability, PLY + 10 < Y} + P{Y + 
10 < X}, which, by symmetry, equals 2P{X + 10 < Y}, is obtained as follows: 


2P{X + 10 < Y}=2 // f(x, y) dx dy 
x+10<y 


=2 [| fx fy (y) dx dy 


t10<y 


60 py-10 / 4 2 
—] dxd 
10 I (a) ¢ 
60 


2, 
-—“_| wy-10d 
(60)? Jio 4 . 


_ 25 
36 a 


=2 


Our next example presents the oldest problem dealing with geometrical probabil- 
ities. It was first considered and solved by Buffon, a French naturalist of the 18th 
century, and is usually referred to as Buffon’s needle problem. 


EXAMPLE 2d Buffon’s needle problem 


A table is ruled with equidistant parallel lines a distance D apart. A needle of length L, 
where L = D, is randomly thrown on the table. What is the probability that the nee- 
dle will intersect one of the lines (the other possibility being that the needle will be 
completely contained in the strip between two lines)? 


Solution. Let us determine the position of the needle by specifying (1) the distance X 
from the middle point of the needle to the nearest parallel line and (2) the angle @ 
between the needle and the projected line of length X. (See Figure 6.2.) The needle 
will intersect a line if the hypotenuse of the right triangle in Figure 6.2 is less than 
L/2—that is, if 


xX iE L 
< — or X < =cos@ 
cos 0 2 2 


FIGURE 6.2 
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As X varies between 0 and D/2 and 6 between 0 and 7/2, it is reasonable to assume 
that they are independent, uniformly distributed random variables over these respec- 
tive ranges. Hence, 


P{x < 5030 = [| fx ()fo(y) dx dy 


x<L/2cosy 
4 m/2 pL/2cosy 
= =| / dx dy 
aD 0 0 
4 prey 
= aes > cosy dy 
_ 2h 
~ «aD | 


“EXAMPLE 2e Characterization of the normal distribution 


Let X and Y denote the horizontal and vertical miss distances when a bullet is fired 
at a target, and assume that 


1. X and Y are independent continuous random variables having differentiable 
density functions. 
2. The joint density f(x, y) = fx(x)fy(y) of X and Y depends on (x, y) only through 
oa ye, 
Loosely put, assumption 2 states that the probability of the bullet landing on any 
point of the x-y plane depends only on the distance of the point from the target and 
not on its angle of orientation. An equivalent way of phrasing this assumption is to 
say that the joint density function is rotation invariant. 
It is a rather interesting fact that assumptions 1 and 2 imply that X and Y are 
normally distributed random variables. To prove this, note first that the assumptions 
yield the relation 


fy) = fx@fy(y) = g@? + y’) (2.9) 
for some function g. Differentiating Equation (2.9) with respect to x yields 
fe fy) = 2xg'? + y’) (2.10) 


Dividing Equation (2.10) by Equation (2.9) gives 


fy) _ 2xg! (x2 + y?) 
fx (x) g(x? + y?) 


or 
fy) _ &@? +’) 
2xfx(x) g(x? + y?) 


Because the value of the left-hand side of Equation (2.11) depends only on x, 
whereas the value of the right-hand side depends on x? + y’, it follows that the 
left-hand side must be the same for all x. To see this, consider any x1, x2 and let y;, y2 
be such that a + yy = x5 + ye: Then, from Equation (2.11), we obtain 


(2.11) 


fra) _ KOE + yp) _ O03 +92) _ FQ) 
2xifx) gx + y7) gS + 3) 2xafx (x2) 
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Hence, 
fe@) 
xfx(x) 


which implies, upon integration of both sides, that 


or kas (log fx (x)) = cx 
dx 


2. 
log fx(x) =a + > or fx(x) = ke /? 


Since i een fx(x) dx = 1, it follows that c is necessarily negative, and we may write 
c = —1/o?. Thus, 
pain 


That is, X is a normal random variable with parameters x. = 0 and o”. A similar 
argument can be applied to fy(y) to show that 


1 2 y=? 
yy) = =e” 
Ivy Jno 
Furthermore, it follows from assumption 2 that 0? = G* and that X and Y are thus 
independent, identically distributed normal random variables with parameters yw = 0 
and o°. | 


A necessary and sufficient condition for the random variables X and Y to be 
independent is for their joint probability density function (or joint probability mass 
function in the discrete case) f(x, y) to factor into two terms, one depending only on 
x and the other depending only on y. 


Proposition 2.1. The continuous (discrete) random variables X and Y are indepen- 
dent if and only if their joint probability density (mass) function can be expressed as 
fxy y) = A@)g(y) — 00 < X < 00,-00 < y < 00 


Proof. Let us give the proof in the continuous case. First, note that independence 
implies that the joint density is the product of the marginal densities of X and Y, so 
the preceding factorization will hold when the random variables are independent. 
Now, suppose that 


fx,y@, y) = h@&)g(y) 


i i fx.y (x, y) dx dy 


; h(x) dx : g(y) dy 


=C\C 


Then 


I 


II 


where C; = [°° h(x) dx and Cy = f°. g(y) dy. Also, 


piss / EO ee 


fyQ) = / fx,y(x, y) dx = Cig(y) 
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Since C; C2 = 1, it follows that 


xy, y) = fx fri) 


and the proof is complete. 


EXAMPLE 2f 
If the joint density function of X and Y is 


f@,y) = 667% e—3v 0O<x<w,0<y<o@ 


and is equal to 0 outside this region, are the random variables independent? What if 
the joint density function is 


and is equal to 0 otherwise? 


Solution. In the first instance, the joint density function factors, and thus the random 
variables, are independent (with one being exponential with rate 2 and the other 
exponential with rate 3). In the second instance, because the region in which the joint 
density is nonzero cannot be expressed in the form x € A, y € B, the joint density does 
not factor, so the random variables are not independent. This can be seen clearly by 
letting 
1 f0<x<1,0<y<1,0<x+y<1 

Ty) = 0 otherwise 


and writing 
fy) = 24xy I(x, y) 


which clearly does not factor into a part depending only on x and another depending 


only on y. a 

The concept of independence may, of course, be defined for more than two random 
variables. In general, the n random variables X1,X2,..., Xj, are said to be indepen- 
dent if, for all sets of real numbers Aj, A2,..., An, 


n 
P(X, € Aj, Xp € Az,...,Xn € An} = | | PLXi € Ad} 
Zl 


As before, it can be shown that this condition is equivalent to 


PLX, = 4, X72 = &,...,Xn = an} 


n 
] | PQG = ai} for all ay,az,...,4n 
i=] 


Finally, we say that an infinite collection of random variables is independent if every 
finite subcollection of them is independent. 
EXAMPLE 2g How can a computer choose a random subset? 


Most computers are able to generate the value of, or simulate, a uniform (0, 1) random 
variable by means of a built-in subroutine that (to a high degree of approximation) 
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produces such “random numbers.” As a result, it is quite easy for a computer to sim- 
ulate an indicator (that is, a Bernoulli) random variable. Suppose J is an indicator 
variable such that 


Pifath=pai= Pra} 


The computer can simulate J by choosing a uniform (0, 1) random number U and 
then letting 


y_ i itU <p 
~ 0if U=p 


Suppose that we are interested in having the computer select k,k = n, of the num- 
bers 1,2,..., in such a way that each of the ( ' ) subsets of size k is equally likely 
to be chosen. We now present a method that will enable the computer to solve this 
task. To generate such a subset, we will first simulate, in sequence, n indicator vari- 
ables 1, /,...,In, of which exactly k will equal 1. Those i for which J; = 1 will then 
constitute the desired subset. 

To generate the random variables ),..., J,, start by simulating n independent uni- 
form (0, 1) random variables U1, U2,..., Un. Now define 


k 

1 if - 

h = 1 U, <= = 

0 otherwise 

and then, once /,,...,/; are determined, recursively set 
k-( vedtleny 
i: Uy = oe ee 
fini = n—-i 


0 otherwise 


In words, at the (i + 1)th stage we set J;,; equal to 1 (and thus put i + 1 into the 
desired subset) with a probability equal to the remaining number of places in the sub- 


i 
set | namely,k — > J; |, divided by the remaining number of possibilities (namely, 
j=l 


n — 1). Hence, the joint distribution of 1, ,..., J; is determined from 

k 
PLR =1j=- 
n 

i 

k- So] 
j=1 
Pi =1h,...,4} = —2— 1<i<n 
n-i 


The proof that the preceding formula results in all subsets of size k being equally 
likely to be chosen is by induction on k + n. It is immediate when k + n = 2 (that 
is, when k = 1,n = 1), so assume it to be true whenever k + n < I. Now, suppose 
that k + n=1/ + 1, and consider any subset of size k—say, ij S iz S +--+ S ig—and 
consider the following two cases. 
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Casel: i; =1 


Pi =f, =---=h, =1,4 = 0 otherwise} 
= P{ =VjPU, =--- = Fi, = 1,1; = 0 otherwise|/, = 1} 

Now given that /; = 1, the remaining elements of the subset are chosen as if a 
subset of size k — 1 were to be chosen from the n — 1 elements 2,3,...,n. Hence, 
by the induction hypothesis, the conditional probability that this will result in a given 
subset of size k — 1 being selected is 1/ ; 7 : . Hence, 

Ph =f, =-:- =], =1,4; = 0 otherwise} 
_k 1 ee 
nf(n-1 n 
k-1 k 
Case2: i; 4 1 
Pi, =f, = ++: = Ti, = 1,1; = 0 otherwise} 
= Pj, =--- =f, =1,1; = 0 otherwise|J, = 0}P{, = 0} 


“Tl y"Tay 


where the induction hypothesis was used to evaluate the preceding conditional prob- 


ability. 
Thus, in all cases, the probability that a given subset of size k will be the subset 
: n 
chosen is 1/ ({ ai 


Remark. The foregoing method for generating a random subset has a very low 
memory requirement. A faster algorithm that requires somewhat more memory is 
presented in Section 10.1. (The latter algorithm uses the last k elements of a random 
permutation of 1,2,...,7.) | 


EXAMPLE 2h 


Let X, Y, Z be independent and uniformly distributed over (0, 1). Compute P{X = 
YZ}. 


Solution. Since 
feyxzG5)V. D=ROAPOe@=1 Vex Ha10eyel0=z21 


we have 


Px vz}= | | f tx. y, Z(x, y, Z) dx dy dz 


X=yZ 


1 pl pl 
— / i; i dx dy dz 
0 JO Jyz 
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1 pl 
=] / (1 — yz) dydz 
0 JO 
: Zz 


EXAMPLE 2: Probabilistic interpretation of half-life 


Let N(t) denote the number of nuclei contained in a radioactive mass of material at 
time t. The concept of half-life is often defined in a deterministic fashion by stating 
this it is an empirical fact that, for some value h, called the half-life, 


N(®) =2-/*#N(O) t > 0 


[Note that N(h) = N(0)/2.] Since the preceding implies that, for any nonnegative s 
and ft, 
N(t + s) =2-©94N() = 2-/* Ns) 


it follows that no matter how much time s has already elapsed, in an additional time ¢ 
the number of existing nuclei will decrease by the factor 2~“/”, 

Because the deterministic relationship just given results from observations of radio- 
active masses containing huge numbers of nuclei, it would seem that it might be 
consistent with a probabilistic interpretation. The clue to deriving the appropriate 
probability model for half-life resides in the empirical observation that the propor- 
tion of decay in any time interval depends neither on the total number of nuclei at 
the beginning at the interval nor on the location of this interval (since N(t + s)/N(s) 
depends neither on M(s) nor ons). Thus, it appears that the individual nuclei act inde- 
pendently and with a memoryless life distribution. Consequently, since the unique life 
distribution that is memoryless is the exponential distribution, and since exactly one- 
half of a given amount of mass decays every / time units, we propose the following 
probabilistic model for radioactive decay. 


Probabilistic interpretation of the half-life h: The lifetimes of the individual nuclei 
are independent random variables having a life distribution that is exponential with 
median equal to h. That is, if L represents the lifetime of a given nucleus, then 


PIL < f=1 — 2-4 
(Because P{L < h} = 5 and the preceding can be written as 


log2 
h 


P{L < t}=1—- exp {1 


it can be seen that L indeed has an exponential distribution with median h.) 

Note that, under the probabilistic interpretation of half-life just given, if one starts 
with N(0) nuclei at time 0, then N(f), the number of nuclei that remain at time f, 
will have a binomial distribution with parameters n = N(0) and p = 2~“/"., Results of 
Chapter 8 will show that this interpretation of half-life is consistent with the determin- 
istic model when considering the proportion of a large number of nuclei that decay 
over a given time frame. However, the difference between the deterministic and prob- 
abilistic interpretation becomes apparent when one considers the actual number of 


250 Chapter 6 


Jointly Distributed Random Variables 


decayed nuclei. We will now indicate this with regard to the question of whether 
protons decay. 

There is some controversy over whether or not protons decay. Indeed, one theory 
predicts that protons should decay with a half-life of about h = 10°° years. To check 
this prediction empirically, it has been suggested that one follow a large number of 
protons for, say, one or two years and determine whether any of them decay within 
that period. (Clearly, it would not be feasible to follow a mass of protons for 10°” 
years to see whether one-half of it decays.) Let us suppose that we are able to keep 
track of N(0) = 10°° protons for c years. The number of decays predicted by the 
deterministic model would then be given by 


N(0) — N(c) =hA — 27°") 


ls Q-¢/h 
1/h 
1-2°>% 1 
= lim ———— since— — 10-9 = 0 
x0 Xx h 


lim (c2-“ log2) by L’H6pital’s rule 
x0 
=clog2 ~ .6931c 


For instance, the deterministic model predicts that in 2 years there should be 1.3863 
decays, and it would thus appear to be a serious blow to the hypothesis that protons 
decay with a half-life of 10°" years if no decays are observed over those 2 years. 

Let us now contrast the conclusions just drawn with those obtained from the prob- 
abilistic model. Again, let us consider the hypothesis that the half-life of protons is 
h = 10°° years, and suppose that we follow h protons for c years. Since there is a 
huge number of independent protons, each of which will have a very small probabil- 
ity of decaying within this time period, it follows that the number of protons which 
decay will have (to a very strong approximation) a Poisson distribution with parame- 
ter equal to h(1 — 2-°/") = clog2. Thus, 


P{0 decays} = e~°!°8? 

1 
— p— log(2°) _ 

= ee = 9p 


and, in general, 


[clog 2]” 


2 
P{n decays} = n=O 


n!} 

Thus we see that even though the average number of decays over 2 years is (as pre- 
dicted by the deterministic model) 1.3863, there is 1 chance in 4 that there will not 
be any decays, thereby indicating that such a result in no way invalidates the original 
hypothesis of proton decay. a 


Remark. I/ndependence is a symmetric relation. The random variables X and Y 
are independent if their joint density function (or mass function in the discrete case) 
is the product of their individual density (or mass) functions. Therefore, to say that 
X is independent of Y is equivalent to saying that Y is independent of X—or just 
that X and Y are independent. As a result, in considering whether X is independent 
of Y in situations where it is not at all intuitive that knowing the value of Y will not 
change the probabilities concerning X, it can be beneficial to interchange the roles of 
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X and Y and ask instead whether Y is independent of X. The next example illustrates 
this point. | 


EXAMPLE 2j 


If the initial throw of the dice in the game of craps results in the sum of the dice 
equaling 4, then the player will continue to throw the dice until the sum is either 4 or 
7. If this sum is 4, then the player wins, and if it is 7, then the player loses. Let N denote 
the number of throws needed until either 4 or 7 appears, and let XY denote the value 
(either 4 or 7) of the final throw. Is N independent of X? That is, does knowing which 
of 4 or 7 occurs first affect the distribution of the number of throws needed until that 
number appears? Most people do not find the answer to this question to be intuitively 
obvious. However, suppose that we turn it around and ask whether X is independent 
of N. That is, does knowing how many throws it takes to obtain a sum of either 4 or 
7 affect the probability that that sum is equal to 4? For instance, suppose we know 
that it takes n throws of the dice to obtain a sum of either 4 or 7. Does this affect the 
probability distribution of the final sum? Clearly not, since all that is important is that 
its value is either 4 or 7, and the fact that none of the first m — 1 throws were either 4 
or 7 does not change the probabilities for the nth throw. Thus, we can conclude that 
X is independent of N, or equivalently, that N is independent of X. 

As another example, let X1, X2,... be a sequence of independent and identically 
distributed continuous random variables, and suppose that we observe these random 
variables in sequence. If X, > X; for eachi = 1,...,n — 1, then we say that X;, is 
a record value. That is, each random variable that is larger than all those preceding 
it is called a record value. Let A, denote the event that X,, is a record value. Is Ay,44 
independent of A,? That is, does knowing that the nth random variable is the largest 
of the first n change the probability that the (7 + 1)st random variable is the largest 
of the first n + 1? While it is true that A,41 is independent of Ay, this may not be 
intuitively obvious. However, if we turn the question around and ask whether A,, is 
independent of A,,,1, then the result is more easily understood. For knowing that 
the (n + 1)st value is larger than Xj,...,X), clearly gives us no information about 
the relative size of X;, among the first n random variables. Indeed, by symmetry, it is 
clear that each of these n random variables is equally likely to be the largest of this 
set, so P(Ay|Any1) = P(An) = 1/n. Hence, we can conclude that A, and A, are 
independent events. | 


Remark. It follows from the identity 


P(X, = a,...,Xn = an} 
= P(X, = a} P{X2 = ag|X1 = ay}---P{Xy = an|X1 = ,...,Xn-1 = Gn-1} 


that the independence of X1,..., Xn can be established sequentially. That is, we can 
show that these random variables are independent by showing that 


X2 isindependent of X, 


X3 isindependent of X 1, X2 
X4 is independent of X1, X2,X3 


Xy, is independent of X1,...,Xn-1 
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6.3 SUMS OF INDEPENDENT RANDOM VARIABLES 


It is often important to be able to calculate the distribution of X + Y from the dis- 
tributions of X and Y when X and Y are independent. Suppose that X and Y are 
independent, continuous random variables having probability density functions fy 
and fy. The cumulative distribution function of X + Y is obtained as follows: 


ew=Px eed 
[[ #efror ara 


X+ySa 


oo =pa—y 
i i fx @)fy (y) dx dy (3.1) 


oo =pa—y 
-| fe@defy(y) dy 


—CO ¥ —0O 


= i; Fx(a — y)fy(y) dy 


The cumulative distribution function Fy+y is called the convolution of the distribu- 
tions Fy and Fy (the cumulative distribution functions of X and Y, respectively). 

By differentiating Equation (3.1), we find that the probability density function 
fx+y of X + Y is given by 


d [o.6) 
fsa) == [Feta ~ yfvordy 


Cc 


-|/ Sta = ieindy (3.2) 


oo da 


=] fx(a — y)fy() dy 


6.3.1 Identically Distributed Uniform Random Variables 


It is not difficult to determine the density function of the sum of two independent 
uniform (0,1) random variables. 


EXAMPLE 3a Sum of two independent uniform random variables 


If X and Y are independent random variables, both uniformly distributed on (0, 1), 
calculate the probability density of X + Y. 


Solution. From Equation (3.2), since 


10<a<l1 
0 otherwise 


fx(@) = fy@ = 


we obtain 


1 
fx+y(a) = [ fx(a — y)dy 


For 0 = a S 1, this yields 
a 
fx+y(@) = / dy=a 
0 
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fix) 


0 1 2 


FIGURE 6.3: Triangular density function. 


For 1 < a < 2, we get 
1 


fx+y(@) = dy=2-a 
a-1 
Hence, 
a Osazsl 
fxay@M=42-a 1<a<2 
0 otherwise 


Because of the shape of its density function (see Figure 6.3), the random variable 


X + Y is said to have a triangular distribution. a 
Now, suppose that X1, X2,...,X, are independent uniform (0,1) random variables, 
and let 


Fry(x) = PLX, +... + Xn S x} 


Whereas a general formula for F;,(x) is messy, it has a particularly nice form when 
x = 1. Indeed, we now use mathematical induction to prove that 


Fi(x)=x"/n!, OsSxsl 
Because the proceeding equation is true for n = 1, assume that 
Frag) =x""/(a—1)!, Osx51 


Now, writing 
n n—-1 
DXi = DX + Xn 
i=1 i=1 


and using the fact that the X; are all nonnegative, we see from Equation 3.1 that, for 
Osx <1, 


1 
Fu(x) = f Fe — y) fx, (ydy 


1 x 
= nm DI i (x — y)’~! dy _ by the induction hypothesis 
= x"/n! 


which completes the proof. 
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For an interesting application of the preceding formula, let us use it to determine 
the expected number of independent uniform (0,1) random variables that need to 
be summed to exceed 1. That is, with X1, X2,... being independent uniform (0, 1) 
random variables, we want to determine E[N], where 


N=min{n: X1 +... + Xn > 1} 
Noting that N is greater thann > Oif and only if Xj + ... + X, = 1, we see that 
n>0O 


P{N > n} =F,(01) = 1/n!, 


Because 
P{N > 0} =1=1/0! 


we see that, form > 0, 


PEST SEN ot Tio EIN ee a n= al 


Therefore, 


That is, the mean number of independent uniform (0,1) random variables that must 
be summed for the sum to exceed 1 is equal to e. 


6.3.2. Gamma Random Variables 
Recall that a gamma random variable has a density of the form 


re (Ay) 


fm= FO 


0<y<oo 
An important property of this family of distributions is that, for a fixed value of 4, it 
is closed under convolutions. 


Proposition 3.1. If X and Y are independent gamma random variables with respec- 
tive parameters (s, A) and (t,A), then XY + Y isa gamma random variable with param- 
eters (s + 1£,A). 


Proof. Using Equation (3.2), we obtain 
1 
rora 


a 
=Ke™ [ (a _ yyy 


fxs¥@ = is re" Ta — yy} tae? (ay) dy 
0 


1 
= a dala) (d — x)lxl dx by letting x = . 
0 a 


_ Ce gst 
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where C is a constant that does not depend on a. But, as the preceding is a density 
function and thus must integrate to 1, the value of C is determined, and we have 


ner (Aa)s+t-1 


fx+y(a) = To +d 


Hence, the result is proved. 


It is now a simple matter to establish, by using Proposition 3.1 and induction, that if 
Xj,i=1,...,n are independent gamma random variables with respective parameters 


n n 
(tj,A),i = 1,...,n, then )° Xj is gamma with parameters | >> wa} We leave the 


i=l i=1 
proof of this statement as an exercise. 
EXAMPLE 3b 
Let X1, X2,..., X;, ben independent exponential random variables, each having param- 


eter 4. Then, since an exponential random variable with parameter i is the same as 
a gamma random variable with parameters (1, A), it follows from Proposition 3.1 that 
X, + X. + --- + Xp isa gamma random variable with parameters (n, A). | 


If Z1,Z2,...,Z, are independent standard normal random variables, then Y = 
n 
» Z is said to have the chi-squared (sometimes seen as x*) distribution with n 
i=1 
degrees of freedom. Let us compute the density function of Y. Whenn = 1, Y = Zi 
and from Example 7b of Chapter 5, we see that its probability density function is 
given by 


1 
fry) = 7g fzvy) + fz(-y)] 


1 2 
ee ——t 
2/Y J/2n 
ze P(y/ay?t 

aE 


—y/2 


. : . . : : ‘bi 
But we recognize the preceding as the gamma distribution with parameters (3, 3). 
[A by-product of this analysis is that [ (3) = ./z.] But since each Zz: is gamma 
(3, +), it follows from Proposition 3.1 that the x? distribution with n degrees of 


freedom is just the gamma distribution with parameters (n/2, 2) and hence has a 
probability density function given by 


1 -y2 Cm 
fe) = : y>0 
r(5) 
eo ¥Ayn/2-l ~ 


— n 
2n/2. _ 
(5) 
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When nis an even integer, [(n/2) = [(n/2) — 1]!, whereas when n is odd, ['(n/2) can 
be obtained from iterating the relationship [(4) = (¢ — 1)P(t — 1) and then using 
the previously obtained result that T (3) = 4/z. [For instance, T° (3) = 37 (3) — 
sir (8) = 47 

In practice, the chi-squared distribution often arises as the distribution of the square 
of the error involved when one attempts to hit a target in n-dimensional space when 


the coordinate errors are taken to be independent standard normal random variables. 
It is also important in statistical analysis. 


6.3.3. Normal Random Variables 


We can also use Equation (3.2) to prove the following important result about normal 
random variables. 


Proposition 3.2. If X;j,i = 1,...,n, are independent random variables that are nor- 


n 
mally distributed with respective parameters j1;, a, i=1,...,n,then )° X; is normally 
i=l 


n n 
distributed with parameters )> jz; and )° o?. 
i=1 i=1 


Proof of Proposition 3.2: To begin, let X and Y be independent normal random 
variables with X having mean 0 and variance o* and Y having mean 0 and vari- 
ance 1. We will determine the density function of X + Y by utilizing Equation (3.2). 


Now, with 
1 1 1+ 
c= + = 
202 2 202 
we have 
1 (a—y)|{ 1 y 
(a — y)fy(y) = —=— ex ex 
fe y fy an | Ge i ie le 


Hence, from Equation (3.2), 


ps is a 
a)= ex exp 4 —.———- 
ie 210 P 202 P 207(1 + o7) 


: ex a is exp{ a d. 
= =—— —_—_—__ —cx~} dx 
Ino P|) 204 04(Jo 


a 
5a 


where C does not depend on a. But this implies that X + Y is normal with mean 0 
and variance 1 + o7. 
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Now, suppose that X; and X2 are independent normal random variables with X; 
having mean j; and variance o?,i = 1,2. Then 


Ay pa. Ae — pa 
X, + X= 00( r fy + L2 


02 02 


But since (X1 — 41)/o2 is normal with mean 0 and variance a; / Oe, and (X2 — [2)/o2 
is normal with mean 0 and variance 1, it follows from our previous result that (Xx; — 
[4)/o2 + (X2 — U2)/o2 is normal with mean 0 and variance 1 + ar for, implying 
that _X; + X> is normal with mean ju; + 2 and variance a3 (1 + o; /o3) = G} + re 

Thus, Proposition 3.2 is established when n = 2. The general case now follows by 
induction. That is, assume that Proposition 3.2 is true when there aren — 1 random 
variables. Now consider the case of n, and write 


n n—-1 
d Xi= DX + Xn 
i=1 i=1 


n—-1 n—1 n—1 
By the induction hypothesis, )~ X; is normal with mean )* y; and variance )* o?. 
i=l i=l i=l 


n n 
Therefore, by the result for n = 2, }> X; is normal with mean )> 1; and variance 
i=1 i=1 


EXAMPLE 3c 


A basketball team will play a 44-game season. Twenty-six of these games are against 
class A teams and 18 are against class B teams. Suppose that the team will win each 
game against a class A team with probability .4 and will win each game against a class 
B team with probability .7. Suppose also that the results of the different games are 
independent. Approximate the probability that 


(a) the team wins 25 games or more; 
(b) the team wins more games against class A teams than it does against class B 
teams. 


Solution. (a) Let X4 and Xz respectively denote the number of games the team 
wins against class A and against class B teams. Note that X,4 and Xz are independent 
binomial random variables and 


E[X4] = 26(.4) = 10.4 Var(X4) = 26(.4)(.6) = 6.24 
E[Xg] = 18(.7) = 12.6 Var(Xg) = 18(.7)(.3) = 3.78 


By the normal approximation to the binomial, X4 and Xg will have approximately 
the same distribution as would independent normal random variables with the pre- 
ceding expected values and variances. Hence, by Proposition 3.2, X4 + Xp will have 
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approximately a normal distribution with mean 23 and variance 10.02. Therefore, 
letting Z denote a standard normal random variable, we have 


P{X, + Xp = 25} = P(X, + Xp = 24.5} 
-P|% + Xp — 23 _ 245 — >| 


10.02 ~~ «/ 10,02 


1.5 
x PRZ= 
2 = a| 
1 — P{Z < .4739} 
3178 


2 


2 


(b) We note that X4 — Xg will have approximately a normal distribution with 
mean —2.2 and variance 10.02. Hence, 


Py = Xe Ss SP = 2p Se 
_ p|\ Xa = Xp +22 5422 
/10.02 ~ /10.02 


24 
we PYZ = 
| in| 
1 — P{Z < .8530} 
1968 


2 


2 


Therefore, there is approximately a 31.78 percent chance that the team will win at 
least 25 games and approximately a 19.68 percent chance that it will win more games 
against class A teams than against class B teams. | 


The random variable Y is said to be a lognormal random variable with parame- 
ters w and o if log (Y) is a normal random variable with mean pw and variance oa. 


That is, Y is lognormal if it can be expressed as 
Y =e* 
where X is a normal random variable. 


EXAMPLE 3d 


Starting at some fixed time, let S(7) denote the price of a certain security at the end 
of n additional weeks, n = 1. A popular model for the evolution of these prices 
assumes that the price ratios S(m)/S(n — 1),n = 1, are independent and identi- 
cally distributed lognormal random variables. Assuming this model, with parameters 
pe = .0165,0 = .0730, what is the probability that 


(a) the price of the security increases over each of the next two weeks? 
(b) the price at the end of two weeks is higher than it is today? 


Solution. Let Z be a standard normal random variable. To solve part (a), we use the 
fact that log(x) increases in x to conclude that x > 1 if and only if log(x) > log(1) = 0. 
As a result, we have 
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S(1) - S(1) 
{5m > 1} = plioe(5t) > of 


_ phy = TWi9s 
= ~ 0730 
= P{Z < 2260} 


= 5894 


In other words, the probability that the price is up after one week is .5894. Since the 
successive price ratios are independent, the probability that the price increases over 
each of the next two weeks is (.5894)” = .3474. 

To solve part (b), we reason as follows: 


S(2) _ pf SQ SQA) 
Plo > f=? {soso > *f 


S(2 Sa 
=P {ioe (5) tog (32) = | 


However, log (3) + log (Stn ), being the sum of two independent normal random 


variables with a common mean .0165 and a common standard deviation .0730, is a 
normal random variable with mean .0330 and variance 2(.0730)*. Consequently, 


S(2) — 0330 
Pl a Pe PLZ = 
ko ” | ~ (0730V2 | 
= P{Z < .31965} 
= 6254 a 


6.3.4 Poisson and Binomial Random Variables 

Rather than attempt to derive a general expression for the distribution of X + Y in 
the discrete case, we shall consider some examples. 

EXAMPLE 3e Sums of independent Poisson random variables 


If X and Y are independent Poisson random variables with respective parameters A, 
and 42, compute the distribution of X + Y. 


Solution. Because the event {X + Y =n} may be written as the union of the disjoint 
events {X¥ =k, Y =n — k},0 Sk =n, we have 


PIX + V=an}=) PX =k, Yan —- ky 
k=0 


=) P(X =hP{Y¥=n- kj 
k=0 
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n kyn—-k 
= eo Ort) Aah 
k\(n — k)! 
k=0 
e~Aiti2) ” ni r 
l iin — by! 
n! am k\(n k)! 


e7 A1tA2) 
n 
= (1 + Ay) 
n! 


kyn-k 
1 


n 
2 


Thus, X; + X2 has a Poisson distribution with parameter A, + Az. | 


EXAMPLE 3f Sums of independent binomial random variables 


Let X and Y be independent binomial random variables with respective parameters 
(n, p) and (m, p). Calculate the distribution of X + Y. 


Solution. Recalling the interpretation of a binomial random variable, and without 
any computation at all, we can immediately conclude that X + Y is binomial with 
parameters (n + m,p). This follows because X represents the number of successes in 
n independent trials, each of which results in a success with probability p; similarly, 
Y represents the number of successes in m independent trials, each of which results 
in a success with probability p. Hence, given that X and Y are assumed independent, 
it follows that X + Y represents the number of successes inn + m independent 
trials when each trial has a probability p of resulting in a success. Therefore, X¥ + Y 
is a binomial random variable with parameters (1 + m,p). To check this conclusion 
analytically, note that 


PIX +VY=khh=) PX =i,Y=k—- 3} 
i=0 


=) P(X =jP(¥ =k - 3 
i=0 


where g = 1 — p and where (;) =0whenj < 0. Thus, 


and the conclusion follows upon application of the combinatorial identity 


CE")-EC)(,) . 


i=0 


6.3.5 Geometric Random Variables 


Let X1,...,X, be independent geometric random variables, with X; having parame- 
ter p; for i = 1,...,n. We are interested in computing the probability mass function 
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of their sum S, = )~;_, Xj. For an application, consider n coins, with coin i having 
probability p; of coming up heads when flipped, 7 = 1,...,n. Suppose that coin 1 is 
flipped until heads appears, at which point coin 2 is flipped until it shows heads, and 
then coin 3 is flipped until it shows heads, and so on. If we let X; denote the number 
of flips made with coin i, then X71, X2,..., X» will be independent geometric random 
variables with respective parameters p1,p2,...,Pn,and S, = pa X; will represent 
the total number of flips. If all the p; are equal—say, all p; = p—then S,, has the same 
distribution as the number of flips of a coin having probability p of coming up heads 
that are needed to obtain a total of m heads, and so S,, is a negative binomial random 
variable with probability mass function 


re | 
P{Sp = k} = (; = ie" — py", k2=n 


As a prelude to determining the probability mass function of S, when the p; are all 
distinct, let us first consider the case n = 2. Letting gj = 1 — pj, j = 1,2, we obtain 


k-1 
P(S2 =H =) P(X =j,X. =k — j} 
j=l 
k-1 
= Pe 1=j}P{X. =k — j} (by independence) 
j=l 


i 
=) pigy Pod, 
j=l 


ei 
Re = 

= pipoqy * Y(qi/q2)"| 
A 
1 — (q1/q2)*1 

1 — q1/@2 
_ piped; pipet 

qa- 1 q2—- "1 

k-1 PI k-1 P2 


=P2q9  ——_ + P1iqy 
P1 — P2 P2— P1 


= piproqk* 


If we now let n = 3 and compute P{S3 = k} by starting with the identity 


k-1 k-1 
P{S3 =k} = D> P{S) =j,X3 =k — j=) _ P{S) =JP(X3 =k — j} 
j=l j=l 


and then substituting the derived formula for the mass function of $2, we would 
obtain, after some computations, 


= P2 P3 a P1 D3 
P(S3 =k} =pigk"! + pogk | 
P2 — Pi P3 — Pi Pi — P2P3 — P2 
k-1 Pl P2 


+ p3q 
3 pi — P3P2 — 3 
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The mass functions of $2 and $3 lead to the following conjecture for the mass function 
of S). 


Proposition 3.3. Let X1,...,X;, be independent geometric random variables, with X; 
having parameter p; fori =1,...,n. If all the p; are distinct, then, for k = n, 
P{Sp = = Dat ee ee 
pee ~ Fi 


Proof of Proposition 3.3: We will prove this proposition by induction on the value 
of n + k. Because the proposition is true when n = 2,k = 2, take as the induction 
hypothesis that it is true for any k = n for whichn + k = r. Now, suppose k = n are 
such thatn + k =r + 1.To compute P{S, = k}, we condition on whether X, = 1. 
This gives 


P{Sy = k} = P{Sp = k|Xn = WP{X, = 1} + PLS, = kIXn > UPIX, > VY 
= P{S, =k|\Xn = pe + P{S:=hXn > Van 


Now, 


P{Sp = k|Xp = 1} = P{Sp_1 =k — 1|Xp = 1} 
= P{Sn-1 =k — 1} (by independence) 
n—-1 
= S pigs? I] =a (by the induction hypothesis) 
=] i, 1Pji — Pi 
i= iAjsn—1 
Now, if X is geometric with parameter p, then the conditional distribution of X given 
that it is larger than 1 is the same as the distribution of 1 (the first failed trial) plus 
a geometric with parameter p (the number of additional trials after the first until a 
success occurs). Consequently, 


PS =k, DSP eae ee te EIS 


== PSs =k— I 
= = Dat of ears 
mae Pr 


where the final equality follows from the induction hypothesis. Thus, from the pre- 
ceding, we obtain 


n—-1 
P{Sn =k} =pn pik JT] —4+— + an Da ? renee = 
i=1 iAjsn—-1 Bj — Pi me ixjen P Pe 
= mS ee un dra : ee 
iAfSn— 1? izjsn P 
+ Capua. ee 
n 


j<n 


n-1 
=) > pial Pall + 5 —"_) |] 
i=1 


Pi iAfSn— 1? Fees 


+ Pun ‘gon 


— Pn 
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Now, using that 


14 Qn Pn ~ PiT An _ qi 
= = 


Pn — Pi Pn — Pi Pn — Pi 


the preceding gives 


P{Sp = k} = Sat : OE canes - + Pad Ue ae 


in ane 


= Deal 


jAi 


a 


ae = ser 
and the proof by induction is complete. 
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Recall that, for any two events E and F, the conditional probability of E given F is 


defined, provided that P(F) > 0, by 


P(EF) 


Hence, if X and Y are discrete random variables, it is natural to define the conditional 


probability mass function of X given that Y = y, by 


pxiy(ly) = P{xX =x|Y =y} 


_ PIX =x,Y=y} 
P{Y=y} 
_ P(x, y) 
Py\y) 


for all values of y such that py(y) > 0. Similarly, the conditional probability distribu- 


tion function of X given that Y = y is defined, for all y such that py(y) > 0, by 


Fyy(aly) = PX = 2|¥ = y} 
=) pxiy (aly) 


asx 


In other words, the definitions are exactly the same as in the unconditional case, 
except that everything is now conditional on the event that Y = y. If X is indepen- 
dent of Y, then the conditional mass function and the distribution function are the 
same as the respective unconditional ones. This follows because if X is independent 


of Y, then 


pryvoOW= Fix =AY =y} 
_ PIX =x,Y=y} 
P(Y = y} 
_ PixkeaPry =i 
P{Y = y} 
= P{X =x} 
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EXAMPLE 4a 
Suppose that p(x, y), the joint probability mass function of X and Y, is given by 


p0,0)=.4 p0,l)=.2 pd,o=.1 pd,l)=.3 
Calculate the conditional probability mass function of X given that Y = 1. 


Solution. We first note that 


py(l) = >) p(x, 1) = p,1) + pd, =.5 


x 


Hence, 
p(O,1) 2 
Pxy Ol py) 5 
and 
pll,l):. 3 
1 1 => > = 
pxyd|) pel) 5 a 
EXAMPLE 4b 


If X and Y are independent Poisson random variables with respective parameters 11 
and Az, calculate the conditional distribution of X given that X¥ + Y =n. 


Solution. We calculate the conditional probability mass function of X given that XY + 
Y = nas follows: 


PIX =khX + ¥en—F! oo 


P(X + Y=n)} 
PIX =k,Y=n—k 
~ PIX + Y=n} 
PIX =khP{Y=n—k 
~  PLYXY + ¥Y=n} 


where the last equality follows from the assumed independence of X and Y. Recalling 
(Example 3e) that ¥ + Y has a Poisson distribution with parameter A, + A2, we see 
that the preceding equals 


PIX =k|X + Y=n}=—, aa 


-1 
ek eAayn-k | e-Oitiad(qy + Ay)" 
n!} 
n! om 


~ (n — KIKI, + Ao)” 


g (raze rea 

Kk} \A + de Ay + A2 

In other words, the conditional distribution of X given that X + Y = nis the binomial 
distribution with parameters n and A, /(A, + Az). | 


We can also talk about joint conditional distributions, as is indicated in the next 
two examples. 
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EXAMPLE 4c 


Consider the multinomial distribution with joint probability mass function 


: n! n Nk 
Beate Veg a nj = 0, pa: 


Such a mass function results when n independent trials are performed, with each 


trial resulting in outcome i with probability p;, yy pi = 1. The random variables 
Xj,i=1,...,k, represent, respectively, the number of trials that result in outcome i, 
i= 1,...,k. Suppose we are given that n; of the trials resulted in outcome j, for j = 


r+1,...,k, where ar nj =m =n. Then, because each of the other n — m trials 
must have resulted in one of the trials 1,...,7, it would seem that the conditional dis- 
tribution of X1,...,X; is the multinomial distribution on n — m trials with respective 
trial outcome probabilities 


P{outcome ijoutcome is not any of r + 1,...,k} = —,i=1,...,r 


where F, = )-\_, p; is the probability that a trial results in one of the outcomes 
Erne 22 


Solution. To verify this intuition, let 1;,...,,-, be such that )*)_, nj =n — m. Then 
P{X, =n4,..., Xr = Ny|Xp1 = Nyy,..-Xk = Nk} 


_ _ PX = m,.- Xe = Mh 
P(X p41 = Ny4+1>-- Xx = Nk} 


n!} ny Ay r+ Nk 
meng P1 Pr Pray °° Pr 
a n! n—m_Nr+H1 


! Nk 
(ming Prat "Pr 


where the probability in the denominator was obtained by regarding outcomes 1,...,7 
as a single outcome having probability F,, thus showing that the probability is a multi- 
nomial probability on vn trials with outcome probabilities F,,p,41,...,px. Because 
y-1 i =n — m, the preceding can be written as 


PLX, = 1,...,Xp = My |Xpy = Ny y1,--- Xk = Nk} 
(1 — m)! Pt m.. (Pr 


ees = Mp 
ioe FP 


and our intuition is upheld. a 


EXAMPLE 4d 


Consider n independent trials, with each trial being a success with probability p. 
Given a total of k successes, show that all possible orderings of the k successes and 
n — k failures are equally likely. 


Solution. We want to show that, given a total of k successes, each of the (2) possible 
orderings of k successes and n — k failures is equally likely. Let_X denote the number 
of successes, and consider any ordering of k successes and n — k failures, say, 0 = 


(s,5,f,f,...,f). Then 
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P(o,X =k) 
P(X =k) 
P(o) 
~ P(X =k) 
pk — pyr-* 
(Apel — pyr-* 
1 


“a 7 


P(o|X =k = 


6.5 CONDITIONAL DISTRIBUTIONS: CONTINUOUS CASE 


If X and Y have a joint probability density function f(x, y), then the conditional prob- 
ability density function of X given that Y = y is defined, for all values of y such that 


fy(y) > 0, by 
° f(x,y) 


fy) 


To motivate this definition, multiply the left-hand side by dx and the right-hand side 
by (dx dy)/dy to obtain 


fxiy@ly) = 


f(x,y) dx dy 

fy) dy 
FRSA + diye Yay +-ay} 
- Ply =Y¥ <y + dy} 
=Pix=X =x+dxjy=Y=y+4 dy} 


fxiy Gly) dx = 


In other words, for small values of dx and dy, fy;y(x|y)dx represents the conditional 
probability that X is between x and x + dx given that Y is between y and y + dy. 
The use of conditional densities allows us to define conditional probabilities of 
events associated with one random variable when we are given the value of a second 
random variable. That is, if X and Y are jointly continuous, then, for any set A, 


PIX €Al\Y=y}= [ fereyy dx 


In particular, by letting A = (—oo, a], we can define the conditional cumulative distri- 
bution function of X given that Y = y by 


Fx\y(aly) = P(X salY =y} -| fxiy Gly) dx 


The reader should note that, by using the ideas presented in the preceding discussion, 
we have been able to give workable expressions for conditional probabilities, even 
though the event on which we are conditioning (namely, the event {Y = y}) has 
probability 0. 


EXAMPLE 5a 
The joint density of X and Y is given by 

12 

x2 —-x—-—y) O<x<10<y<l1 
fxy=)° . 


0 otherwise 


Compute the conditional density of X given that Y = y, where 0 < y < 1. 
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Solution. For0 < x < 1,0 < y < 1,wehave 


fy) 
fr) 
_ fy) 

fof, y) dx 
_ #*2-—x-Yy) 

fox — x — y)dx 
_ x(2 —x — y) 

—y/2 

6x(2 — x — y) 

= 4 — 3y a 


fxiy (ly) = 


EXAMPLE 5b 
Suppose that the joint density of X and Y is given by 
e*/¥e-y 


(Gy)= y 
0) otherwise 


0<x<w,0<y<o 


Find P{X > 1|/Y = y}. 
Solution. We first obtain the conditional density of X given that Y = y. 


f(x,y) 

fr) 

_ e*/Ve-Y Jy 
ey i ine? dx 


fxiy (ly) = 


= u e*/¥ 
y 


Hence, 


P{X > 1|Y=y} 


1. 


(oe) 
a ew] 

1 
=e tly = 
If X and Y are independent continuous random variables, the conditional density 


of X given that Y = y is just the unconditional density of X. This is so because, in the 
independent case, 


feay) _ fx@fyo) 
fy) fy) 


We can also talk about conditional distributions when the random variables are nei- 
ther jointly continuous nor jointly discrete. For example, suppose that X is a continu- 
ous random variable having probability density function f and N is a discrete random 
variable, and consider the conditional distribution of X given that N = n. Then 


fey @ly) = = fx (x) 
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Pix < X <x +dx|N=n} 


dx 
_ P{IN=n\x < X <x + dx} Pix < X <x + dx} 
- P{N =n} dx 


and letting dx approach 0 gives 


lim Pix < X <x+dx|N=n} _ P{N=n|X =x} 
dx—>0 dx ~~ P{N=n} 


F(x) 


thus showing that the conditional density of X given that N = n is given by 


PIN =n|X = 
fuel) = = — = The) 


EXAMPLE 5c The Bivariate Normal Distribution 


One of the most important joint distributions is the bivariate normal distribution. 
We say that the random variables X, Y have a bivariate normal distribution if, for 
constants [x, y,0, > 0,0, > 0,—-1 < p < 1, their joint density function is given, 
for all —co < x,y < co, by 


1 1 x= fi)" 
on - ("=") 
2roxoy/1 — p? 201 — p”) Ox 


| (: 7 Ms) p(t = MIO = Hy) 


Oy OxOy 


We now determine the conditional density of X given that Y = y. In doing so, we 
will continually collect all factors that do not depend on x and represent them by the 
constants C;. The final constant will then be found by using that pha fxiy ly) dx = 1. 


We have 
f(x,y) 
(x|y) = 
feyy ly Fe) 
= Cif, y) 
1 £2" X(y — py) 
= 2 
oe 2(1 = p?) ( Ox ) . OxOy 
= C3 ex : ee + aay — [ly) 
— 3 p 202(1 = 3 p2) Lx a y My 
2 
C4 ex : aa ) 
= x Xx t 
4 €xp 202(1 = 2) ML CG y Ly 


Recognizing the preceding equation as a normal density, we can conclude that, given 
Y = y, the random variable X is normally distributed with mean wx + p2(y — py) 
5 ) 


and variance of (1 — p’). Also, because the joint density of Y, X is exactly the same as 
that of X, Y, except that 4,,0, are interchanged with jy, oy, it similarly follows that 
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the conditional distribution of Y given X = x is the normal distribution with mean 
bly + pax — px) and variance aod — p’). It follows from these results that the 
necessary and sufficient condition for the bivariate normal random variables X and 
Y to be independent is that p = 0 (a result that also follows directly from their joint 
density, because it is only when p = 0 that the joint density factors into two terms, 
one depending only on x and the other only on y). 


. _ 1 . . . 
With C= Se er the marginal density of X can be obtained from 


fx (x) a | f(x, y) dy 


ove) 2 2 
S| exp : ae oy (eae 
-_— 2(1 — p2) Or oy 


ap % = HY = 2 dy 


Ox0y 


Y-Hy 
Oy 


= if Xx — Mx 3 
fui) = Coyexn| = a -) | 
°° 1 2 X — x 
x [| id — p>) E 20 = “|| dw 
_ 1 xX — Mx 2 2 
= Coyexo| 2a - ( = ) (dl — p | 


ms 1 X — Mx : 
x d 
[| 2(1 — 7) [» aa | " 


Making the change of variables w = gives 


Because 


1 a 1 p 2 
asl o| 2(1 — p?) E ae wd] | au = 


we see that 
fx(x) = Coy 2m (1 — p2) eW 8H 2ae 


= + eo &—lx)?/20¢ 
‘af 2m Ox 
That is, X is normal with mean jy and variance o?. Similarly, Y is normal with 
mean jly and variance ap. |_| 
EXAMPLE 5d 


Consider n + m trials having a common probability of success. Suppose, however, 
that this success probability is not fixed in advance but is chosen from a uniform (0, 1) 
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population. What is the conditional distribution of the success probability given that 
the n + m trials result in n successes? 


Solution. If we let X denote the probability that a given trial is a success, then X 
is a uniform (0, 1) random variable. Also, given that XY = x, the n + m trials are 
independent with common probability of success x, so N, the number of successes, 
is a binomial random variable with parameters (n + m,x). Hence, the conditional 
density of X given that N = nis 


P(N = n|X = xffx(a) 


fx\n(x|n) = PN=a 
« 7 ma — xy!” 
-_ O0O<x<l 
P{N =n} 


Se = x)" 


where c does not depend on x. Thus, the conditional density is that of a beta random 
variable with parameters n + 1,m + 1. 

The preceding result is quite interesting, for it states that if the original or prior 
(to the collection of data) distribution of a trial success probability is uniformly dis- 
tributed over (0, 1) [or, equivalently, is beta with parameters (1, 1)] then the posterior 
(or conditional) distribution given a total of n successes inn + m trials is beta with 
parameters (1 + n,1 + m). This is valuable, for it enhances our intuition as to what 
it means to assume that a random variable has a beta distribution. | 


*6.6 ORDER STATISTICS 


Let X1, X2,...,X» be n independent and identically distributed continuous random 
variables having a common density f and distribution function F’. Define 


X (1) = smallest of X1, X2, ..., Xn 
X (2) = second smallest of X), Xz, ..., Xn 


X(j) = jth smallest of X1, X2, ..., Xn 


Xn) = largest of X1, X2, ..., Xn 


The ordered values Xq) = X(2) = --- S X(q are known as the order statistics cor- 
responding to the random variables X1, X2,..., Xn. In other words, X(1),...,X(n) are 
the ordered values of X),...,Xn. 

The joint density function of the order statistics is obtained by noting that the order 
statistics X(1),...,X (7) will take on the values x1} = x2 = --- S x, if and only if, for 
some permutation (71, i2,...,in) of (1,2,...,7”), 


XxX = Xj,,X2 = Xj,,...,Xn = Xi, 
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Since, for any permutation (i1,...,i,) of (1,2,...,7”), 


é é 
P {ai — 5 < Xi < Xi, + gi 


x ox 1+ Xn (Xi,--- Xi.) 
= e"f(xi,) ++ fin) 
= e"f(x1)--- fn) 


it follows that, for xy < x2 < +++ < Xp, 


€ € € 
~yee0gXn — ~ < XG) < Xn + 5 


g 
Pin - $< Xa <n +5 5 


~ nl e"f(x1) ++ fn) 
Dividing by «” and letting e—0 yields 
ED ae genes X ny (%1.%25--+ Xn) = n'f(x1)---f Gn) x} < x2 << Xn (6.1) 


Equation (6.1) is most simply explained by arguing that, in order for the vector 
(Xq1),--.,X(ny) to equal (x1,...,Xn), it is necessary and sufficient for (Xj,...,Xn,) to 
equal one of the m! permutations of (x1,...,Xn). Since the probability (density) that 
(X1,...,Xn) equals any given permutation of (x1,...,Xn) is just f(x1)---f(%n), Equa- 
tion (6.1) follows. 


EXAMPLE 6a 


Along a road 1 mile long are 3 people “distributed at random.” Find the probability 


that no 2 people are less than a distance of d miles apart when d = 5 


Solution. Let us assume that “distributed at random” means that the positions of the 
3 people are independent and uniformly distributed over the road. If X; denotes the 
position of the ith person, then the desired probability is P{X() > X G1) + di = 
2,3}. Because 


Fxqy,X),Xia 41.%2,%3) = 3! 0 < xy < my < x3 <1 


it follows that 


P(X > Xo-1 + 4,i=2,3} = ee FX a) XQX (41, X2,%3) dx1 dxz dx3 
Xj>xj-1+d 


1-2d pl-d fl 
3! / / / dx3 dx dx, 
0 xy+d Jx2+d 


1-2d pl—d 
6 | (1 —d-— X2) dx7 dx 
0 xy+d 


tod iat oe 
6 i i: y2 dy2 dx, 
0 0 


II 
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where we have made the change of variables yz = 1 — d — x2. Continuing the string 
of equalities yields 


1—2d 
| (= 2d = 4)? da 
0 


Hence, the desired probability that no 2 people are within a distance d of each other 
when 3 people are uniformly and independently distributed over an interval of size 
1 is (1 — 2d)? when d < 5. In fact, the same method can be used to prove that 
when n people are distributed at random over the unit interval, the desired 


probability is 


[1 — (am — 1)d]" whend = = 
n—-1 


The proof is left as an exercise. a 


The density function of the jth-order statistic X(j) can be obtained either by inte- 
grating the joint density function (6.1) or by direct reasoning as follows: In order for 
X(j) to equal x, it is necessary for j — 1 of the n values X1,...,Xy to be less than 
x,n — j of them to be greater than x, and 1 of them to equal x. Now, the probability 
density that any given set of j — 1 of the X;’s are less than x, another given set of 
n — jare all greater than x, and the remaining value is equal to x equals 


[Foy 1 — Fo)" fe) 


Hence, since there are 


( n _ n! 
7 = 1h “i= (n —p!G — 1! 


different partitions of the m random variables X1,...,X;, into the preceding three 
groups, it follows that the density function of Xj) is given by 


fxp@ = [Fay — Fey" f@ (6.2) 


n! 
Ge pig = 1) 
EXAMPLE 6b 


When a sample of 2n + 1 random variables (that is, when 27 + 1 independent and 
identically distributed random variables) is observed, the (n + 1)st smallest is called 
the sample median. If a sample of size 3 from a uniform distribution over (0, 1) is 
observed, find the probability that the sample median is between : and 2. 


Solution. From Equation (6.2), the density of X(2) is given by 


3! 
FX q @) = mt — x) O<x<l 
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Hence, 


1 3 3/4 
Pie 2 hey = or = / x(1 — x) dx 
4 4 1 


x=3/4 


_ x2 x _ 11 
7 2 3 ~ 16 


x=1/4 || 


The cumulative distribution function of X(j) can be found by integrating Equa- 
tion (6.2). That is, 


n! 
R= gig tT! 


Fxg) = 7 iz ~ [F@Oy fL = Foo] fo dx (6.3) 


However, Fx, (y) could also have been derived directly by noting that the jth order 
statistic is less than or equal to y if and only if there are j or more of the X;’s that are 
less than or equal to y. Thus, because the number of X;’s that are less than or equal 
to y is a binomial random variable with parameters n, p = F(y), it follows that 


Fx (vy) = P(X) = y} = P{j or more of the X;’s are = y} 


=U ) Foot - Fox (64) 


If, in Equations (6.3) and (6.4), we take F to be the uniform (0, 1) distribution [that 
is, f(x) =1,0 < x < 1], then we obtain the interesting analytical identity 


n 


n\ x Ak n! i 4 yes 
1 — = Jd - Jdx Osy<1 (65 
(a) Gana 


By employing the same type of argument that we used in establishing 
Equation (6.2), we can show that the joint density function of the order statistics X(j) 
and X(j) wheni < jis 


n! 


y\yi-l 
G-Digria Din — pill (6.6) 
x [FQ — Foad¥ OE — Fapl Ff eare 


fx, Xi Or X) = 


for all xj < xj. 


EXAMPLE 6c Distribution of the range of a random sample 


Suppose that n independent and identically distributed random variables X1, X2,..., 
X,, are observed. The random variable R defined by R = X(n) — X (1) is called the 
range of the observed random variables. If the random variables Xj; have distribution 
function F and density function f, then the distribution of R can be obtained from 
Equation (6.6) as follows: For a = 0, 
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P{RSsage= P{X(n) — X 1) = a} 
// xn Xe (X1,Xn) dx, dXn 


Xn— X4Sa 


x1+a 
~ [. [ or —— [F(xn) — F(x1)]"-7f (1) f Gn) dxn dx, 


II 


Making the change of variable y = F(x,) — F(x1),dy = f(xn) dxn yields 


xy+a 5 F(x1,+a)—F(x1) 3 
/ [F(xn) — F(x)" “fn) dxn = / y"“dy 
x 0 


*1 


1 
= [Fa + a) — F(x)" 
n—1 


Thus, 


P(R<aj=n i [Fon + a) — Fox)}" for) dey (6.7) 


Equation (6.7) can be evaluated explicitly only in a few special cases. One such case 
is when the Xj’s are all uniformly distributed on (0, 1). In this case, we obtain, from 
Equation (6.7), that for0 < a < 1, 


1 
PIR < ah=n if [Fon + a) — Foa)}" for) dey 
0 


1l-a 1 

=n | a dxy + nf (= xy" dey 
0 l-a 

=ntl — aa +a? 


Differentiation yields the density function of the range: given in this case by 


fr(a) = 


nin -~ De® — a) OSasl 

0 otherwise 
That is, the range of n independent uniform (0, 1) random variables is a beta random 
variable with parameters n — 1,2. Oo 


6.7. JOINT PROBABILITY DISTRIBUTION OF FUNCTIONS OF RANDOM VARIABLES 


Let X; and X2 be jointly continuous random variables with joint probability density 
function fy,,x,. It is sometimes necessary to obtain the joint distribution of the ran- 
dom variables Y; and Y2, which arise as functions of X; and _X2. Specifically, suppose 
that Y; = g1(X1, Xz) and Yo = g2(X1, X2) for some functions g; and gp. 

Assume that the functions g; and g2 satisfy the following conditions: 


1. The equations yj = g1(x1,x2) and y2 = g2(x1,x2) can be uniquely solved for x; 
and x2 in terms of y; and y2, with solutions given by, say, x, = 41(1, y2),x2 = 
h2(y1, y2). 

2. The functions g; and gz have continuous partial derivatives at all points (x1, x2) 
and are such that the 2 X 2 determinant 
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O81 981 
Ox, Ox2 | _ dg Og2 0g1 022 4 


0 
dgo dg2 Oxy Ox2 Ox2 Oxy 


J(x1,%2) = 


x, Ax2 


at all points (x1, x2). 


Under these two conditions, it can be shown that the random variables Y; and Y> 
are jointly continuous with joint density function given by 


fv ¥, 01,2) = fix, x5 (%1,%2) I (1,x2)| + (7.1) 


where x1 = 41(y1, y2), x2 = h2(1,y2). 
A proof of Equation (7.1) would proceed along the following lines: 


P{Y, = y1,Y2 = ya} = i FX,,X> (41, X2) dx, dx (7.2) 


(x1,X2)? 
81 (%1,%2) = yy 
82(%1,X2) = y2 


The joint density function can now be obtained by differentiating Equation (7.2) with 
respect to y; and y2. That the result of this differentiation will be equal to the right- 
hand side of Equation (7.1) is an exercise in advanced calculus whose proof will not 
be presented in this book. 


EXAMPLE 7a 


Let X; and X2 be jointly continuous random variables with probability density func- 
tion fx,,x,. Let Yj = X; + X2,Y2 = X, — X>. Find the joint density function of Y; 
and Y2 in terms of fx,_x,. 


Solution. Let gj (x1,x2) =x, + x2 and go(xj,x%2) = x, — x2. Then 


1 


1-2 


1 
J(x1,%2) = | 1 


Also, since the equations yj = x; + x2 and y2 = x1 — X2 have xj = (yj + y2)/2, x2 = 
(v1 — y2)/2 as their solution, it follows from Equation (7.1) that the desired density is 


yot+y2 v1 52) 


1 
fY¥1,¥2 01,92) = 5 fx X2 ( 2 3 9) 


For instance, if X; and X2 are independent uniform (0, 1) random variables, then 


O27 + 232,051 — yo =2 


1 
—_jJ2 
FY¥1,¥20192) | 0 otherwise 
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or if X; and_X> are independent exponential random variables with respective param- 
eters A, and Az, then 


FY1,.¥2 152) 
AtA2 1+ y2 1 — y2 
5) v| in (2 =] ia(2 =)! y+ y2 =0, "1 — y2 = 0 


0 otherwise 


FIGURE 6.4: e = Random point. (X, Y) = (R, ©). 


Finally, if X; and X2 are independent standard normal random variables, then 


fy, .¥, 0152) = AD -toty2)/8+01-92)?/8] 
des Ao 


1 -ot+y)/4 
4a 
__1 e/4 1 e724 


V4n— (V4 


Thus, not only do we obtain (in agreement with Proposition 3.2) that both X; + X2 
and _X, — X> are normal with mean 0 and variance 2, but we also conclude that these 
two random variables are independent. (In fact, it can be shown that if X; and X2 
are independent random variables having a common distribution function F, then 
X, + X> will be independent of X, — X2 if and only if F is a normal distribution 
function.) | 


EXAMPLE 7b 
Let (X, Y) denote a random point in the plane, and assume that the rectangular 
coordinates X and Y are independent standard normal random variables. We are 
interested in the joint distribution of R, ©, the polar coordinate representation of 
(x, y). (See Figure 6.4.) 

Suppose first that X and Y are both positive. For x and y positive, letting r = 


gi (x,y) = /x2 + y? and 6 = g9(x,y) = tan! y/x, we see that 


081 — x 
Oe  -afq2- y2 
gi y 
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dg2_ dt (=) eee 
ox = 1 + (y/x)? \ x2 x2 4 y2 
0g2 1 .-# 


a xlt+ ox] e+ y 


Hence, 


si 2 1 1 
Tey) = too = SS 
’ (x2 + y?)3/2 (x2 + y2)3/2 x2 + y? r 


Because the conditional joint density function of X, Y given that they are both 
positive is 


f(y) _ 2 -o2+y?)/2 


FSV = = = 
pO EY oor oy et = 


,x > 0,y > 0 
we see that the conditional joint density function of R = /X?2 + Y2 and © = 
tan7! (Y/X), given that X and Y are both positive, is 


2 
fr, O|X > 0,Y > I= er. 0<6@<27/2, 0<r<o 
a 


Similarly, we can show that 
2 _2p 
fU,O|X <0,Y > 0)=—re"™ , w/2<O0<n, 0<r<o 
Ae 
2 _pp 
f(r, 0|X <0,¥Y <0)=—re™ , 2 <6 < 3n/2, 0O<r<@ 
1 


2 
fr, O|X > 0,Y < D= per. 3n/2 <0 <2n7, O0<r<o 
a 


As the joint density is an equally weighted average of these 4 conditional joint densi- 
ties, we obtain that the joint density of R, © is given by 


1 2 
f(,8) = 5,76" i 0 <0 < 2z, 0<r<o 
a 


Now, this joint density factors into the marginal densities for R and ©, so R and © 
are independent random variables, with © being uniformly distributed over (0,27) 
and R having the Rayleigh distribution with density 


fr) = rer? 0<r<o 


(For instance, when one is aiming at a target in the plane, if the horizontal and vertical 
miss distances are independent standard normals, then the absolute value of the error 
has the preceding Rayleigh distribution.) 

This result is quite interesting, for it certainly is not evident a priori that a ran- 
dom vector whose coordinates are independent standard normal random variables 
will have an angle of orientation that not only is uniformly distributed, but also is 
independent of the vector’s distance from the origin. 
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If we wanted the joint distribution of R? and O, then, since the transformation 
d= g\(x,y) =x? + y* and @ = g(x,y) = tan! y/x has the Jacobian 


2x 2y 
J. — = yy. X — 2 
x2 4 y2 x2 4 y2 


it follows that 
1 _d/2 1 
f(d,0) = =e — 0<d<o, 0 <0 < 2x 
2 20 


Therefore, R* and © are independent, with R* having an exponential distribution 
with parameter . But because R* = X* + Y?’, it follows by definition that R? has 
a chi-squared distribution with 2 degrees of freedom. Hence, we have a verification 
of the result that the exponential distribution with parameter 5 is the same as the 
chi-squared distribution with 2 degrees of freedom. 

The preceding result can be used to simulate (or generate) normal random vari- 
ables by making a suitable transformation on uniform random variables. Let U; and 
U2 be independent random variables, each uniformly distributed over (0, 1). We will 
transform U;, U2 into two independent unit normal random variables X, and X2 
by first considering the polar coordinate representation (R,@) of the random vec- 
tor (X1, X2). From the preceding, R? and @ will be independent, and, in addition, 
R* = a + Xe will have an exponential distribution with parameter A = 5 But 
—2 log U; has such a distribution, since, for x > 0, 


P{—2log U;, < 1) = P {tog 0; > -5| 
= P{U, > e*/*} 
=i-<¢< 


Also, because 27 U2 is a uniform (0,27) random variable, we can use it to generate 0. 
That is, if we let 


R? = —2log U; 
O =2n U2 
then R? can be taken to be the square of the distance from the origin and @ can be 


taken to be the angle of orientation of (X;, X27). Now, since X; = Rcos0,X2 = 
Rsin ©, it follows that 


X, = /—2 log U; cos(27 U2) 
X27 = /—2 log Uj sin(2z U2) 


are independent standard normal random variables. | 


EXAMPLE 7c 


If X and Y are independent gamma random variables with parameters (a@,A) and 
(6,4), respectively, compute the joint density of U= X + YandV=X/(X + Y). 
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Solution. The joint density of X and Y is given by 


he *(axye-! ae4v (ay)P-! 


fey, y) = F@) Fe) 
a e-Maty) a1 yb] 
(a) (B) 
Now, if gi@7,y) =x + y,go(x,y) =x/@ + y), then 
0g1 _ O81 _ 1 dg2_ 082 _ t 
ox oy ax (x + y)* ay (x + y)? 
SO 
1 1 1 
J(x,y) = y —x ~ yb y 


(x + y) (« + y)? 


Finally, as the equations u = x + y,v=x/(x + y) have as their solutions x = uv, y = 
u(1 — v), we see that 


fu,vu,v) = fx,y[uv,udl — v)Ju 
he awe vd =~ T@ + B) 
Tia + B) P(@)T(B) 
Hence, ¥ + Y and X/(X + Y) are independent, with XY + Y having a gamma dis- 
tribution with parameters (a + 8,4) and X/(X + Y) having a beta distribution with 


parameters (a, 8). The preceding reasoning also shows that B(a, 8), the normalizing 
factor in the beta density, is such that 


1 
B(a, B) =| eo Sa ae 
0 


_ T@r(p) 
~ Tia + B) 


This entire result is quite interesting. For suppose there are n + m jobs to be per- 
formed, each (independently) taking an exponential amount of time with rate 4 to be 
completed and suppose that we have two workers to perform these jobs. Worker I 
will do jobs 1,2,...,”, and worker IJ will do the remaining m jobs. If we let X and Y 
denote the total working times of workers I and II, respectively, then (either from the 
foregoing result or from Example 3b) X and Y will be independent gamma random 
variables having parameters (7,4) and (m, A), respectively. It then follows that, inde- 
pendently of the working time needed to complete all m + m jobs (that is, of X + Y), 
the proportion of this work that will be performed by worker [ has a beta distribution 


with parameters (n, ™). | 
When the joint density function of the m random variables X1, X2,..., Xn is given 
and we want to compute the joint density function of Y;, Y2,..., Yn, where 


Y1 = 81(%1,.-.,Xn) Yo = 82(M1,...,Xn),--- Yn = 8n(X1,--.,Xn) 
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the approach is the same—namely, we assume that the functions g; have continuous 
partial derivatives and that the Jacobian determinant. 


Ogi 0g1 O81 

Ox, 0x2 OXn 

dg2 982 dg2 

J rer = see #0 

1 Xn) 0x1 0X2 OXy 

98n 98n eae 98n 

Ox, Ox? OXn 
at all points (xj,...,X,). Furthermore, we suppose that the equations y; = 
1(X%1,---5Xn), V2 = 82(X1,---,Xn),---5 Yn = Sn(X1,.--,Xn) have a unique solution, say, 


xy = hy (1,---5Yn),--->Xn = Mn (1,---, Yn). Under these assumptions, the joint den- 
sity function of the random variables Y; is given by 

Fir rYn Oto 0003 Ya) = fx. Xp Ode +s Xn) FGA, Xn) (7.3) 
where x; = hj(y1,.--,Vn),f4 = 1,2,...,n. 


EXAMPLE 7d 


Let X1, X2, and X3 be independent standard normal random variables. If Yj = X; + 
X27 + X3,Y2 = X, — Xo, and Y3 = X; — X3, compute the joint density function of 
Mi Fa Ys: 


Solution. Letting Y; = X; + X2 + X3, Yo. = X1 — X20, Y3 = X1 — X3, the Jacobian 
of these transformations is given by 


As the preceding transformations yield that 


Y, + Yo + Y3 Y; — 2Y2 + Y3 Y; + Yo — 2Y3 
i ne X= 


we see from Equation (7.3) that 


f¥1,¥2,¥3 1, Y2, Y3) 


1 yi + yo + y3 yi — 2y2 + y3 yr + y2 — 2y3 
= ai, X2,X3 3 > 3 > 3 


Hence, as 


1 _y3 2 
Pde, Kas 2, 3) = Qn Lini%/? 


we see that 


e201, 92,¥3)/2 


1 
Turn, y2; y3) = 3(20)3/2 
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where 
O(y1, 92,93) 
_(ytyty3\ . (yi — 292 +93)? , (yi t+ y2 - 293) 
~ 3 3 3 
2 
od 2,2. 
=a 372 373 37293 = 
EXAMPLE 7e 


Let X1, X2,...,X, be independent and identically distributed exponential random 
variables with rate A. Let 


(a) Find the joint density function of Y1,..., Yn. 
(b) Use the result of part (a) to find the density of Yn. 


Solution. (a) The Jacobian of the transformations Y; = X1, Y2 = X, + X2,..., 
Y, =X; + --- + Xyis 


1 0 0 0 0 
1 1 0 0 0 
raft 8 
i 44 dasa 


Since only the first term of the determinant will be nonzero, we have J = 1. 
Now, the joint density function of X1,..., Xp is given by 


i=1 
Hence, because the preceding transformations yield 
Ay = Y¥1,X2 = Yo — VY1,...,X;= Yi — Vi-t,.--.-Xn = Yn — Yr 


it follows from Equation (7.3) that the joint density function of Y1,..., Yn is 
fy, geeey Yn (V1 Y25+++5¥n) 


= [Xin VIsV2 = Vissi — Vian = Ya) 
n 

=A exp}—A|y1 + (0% -— ved) 
2 

=Me%n" 0 < y1,0 < yj; — yi_1,i=2,...,n 


=e 0 < y] < yo < ++ < Vn 
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(b) To obtain the marginal density of Y,, let us integrate out the other variables one 
at a time. Doing this gives 


=A"ye 0 < yn < y3 < ++) < Yn 


Continuing, we obtain 


ye 
= Men 0 < y3 < v4 < ++: < Vy 


The next integration yields 


3 
Fagen Ya (04s +5 Yn) = AGO 0 < yq < +--+ < Yy 


Continuing in this fashion gives 


yet ; 

— Ant n —AYn 

fy, Qn) = 4 a=) 0 < yn 

which, in agreement with the result obtained in Example 3b, shows that X; + 
--+ + X, is a gamma random variable with parameters n and 4. a 


*6.8 EXCHANGEABLE RANDOM VARIABLES 


The random variables X1,X2,..., Xn are said to be exchangeable if, for every permu- 
tation ij,...,i, of the integers 1,...,n, 
PAG = Xia = Mig A = He HPL BS 3 Ad = Fo. ig An = An} 
for all x1,...,Xn. That is, the n random variables are exchangeable if their joint distri- 
bution is the same no matter in which order the variables are observed. 
Discrete random variables will be exchangeable if 


P(X, = x1, Xi, = X2,...,Xi, = Xn} = PLM = x1, X2 = X2,...,Xn = Xn} 


for all permutations 7,,...,i,, and all values x1,...,xn. This is equivalent to stating 
that p(x1,x2,...,%n) = P{X, = x1,...,Xn = Xn} is a symmetric function of the vector 
(X1,.--,Xn), which means that its value does not change when the values of the vector 
are permuted. 


EXAMPLE 8a 


Suppose that balls are withdrawn one at a time and without replacement from an 
urn that initially contains 7 balls, of which k are considered special, in such a manner 
that each withdrawal is equally likely to be any of the balls that remain in the urn 
at the time. Let X; = 1 if the ith ball withdrawn is special and let X; = 0 otherwise. 
We will show that the random variables X1,...,X; are exchangeable. To do so, let 
(X1,..-,Xn) be a vector consisting of k ones and n — k zeros. However, before consid- 
ering the joint mass function evaluated at (x;,...,X,), let us try to gain some insight by 


Section 6.8 Exchangeable Random Variables 283 


considering a fixed such vector—for instance, consider the vector (1, 1,0,1,0,...,0, 1), 
which is assumed to have k ones andn — k zeros. Then 


kk In kk —2n k 1 11 
a a te a oe 


which follows because the probability that the first ball is special is k/n, the condi- 
tional probability that the next one is special is (k — 1)/(n — 1), the conditional 
probability that the next one is not special is (n — k)/(n — 2), and so on. By the same 
argument, it follows that p(x1,...,xn) can be expressed as the product of n fractions. 
The successive denominator terms of these fractions will go from m down to 1. The 
numerator term at the location where the vector (x1,...,x,) is 1 for the ith time is 
k — (i — 1), and where it is 0 for the ith time itism — k — (i — 1). Hence, since the 
vector (x1,...,X,) consists of k ones andn — k zeros, we obtain 


pd,1,0,1,0,...,0,1) = 


kin — k)! = 
DOs stn) = e=01,) ee 
i=l 


Since this is a symmetric function of (x1,...,X,), it follows that the random variables 
are exchangeable. | 


Remark. Another way to obtain the preceding formula for the joint probability 
mass function is to regard all the n balls as distinguishable from each other. Then, 
since the outcome of the experiment is an ordering of these balls, it follows that 
there are nm! equally likely outcomes. Finally, because the number of outcomes hav- 
ing special and nonspecial balls in specified places is equal to the number of ways of 
permuting the special and the nonspecial balls among themselves, namely k!(n — k)!, 
we obtain the preceding density function. 


It is easily seen that if X71, X2,..., X, are exchangeable, then each Xj; has the same 
probability distribution. For instance, if X and Y are exchangeable discrete random 
variables, then 


Maa vee vo ye ) Peay =a) SF Sa 
y y 


For example, it follows from Example 8a that the ith ball withdrawn will be special 
with probability k/n, which is intuitively clear, since each of the n balls is equally 
likely to be the ith one selected. 


EXAMPLE 8b 


In Example 8a, let Y; denote the selection number of the first special ball withdrawn, 
let Y> denote the additional number of balls that are then withdrawn until the second 
special ball appears, and, in general, let Y; denote the additional number of balls 
withdrawn after the (i — 1)st special ball is selected until the ith is selected, i = 
1,...,k. For instance, ifn = 4,k = 2 and X; = 1,X2 = 0,X3 = 0,X4 = 1, then 
Y; = 1, Y> =-3; Now, Y; _ iy, Y2 = io,..., Vx = ix =S Xi, = Xi, tin Se SS 
Xi 4.-+i, = 1,X; = 0, otherwise; thus, from the joint mass function of the X;, we 
obtain 


_ kn — b! 


PLY, =, Y2 =h,..., Ve = ig} a 


ytes +isn 


Hence, the random variables Y1,..., Y; are exchangeable. Note that it follows from 
this result that the number of cards one must select from a well-shuffled deck until 
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an ace appears has the same distribution as the number of additional cards one must 
select after the first ace appears until the next one does, and so on. a 


EXAMPLE 8c 


The following is known as Polya’s urn model: Suppose that an urn initially contains 
red and m blue balls. At each stage, a ball is randomly chosen, its color is noted, and 
it is then replaced along with another ball of the same color. Let X; = 1 if the ith ball 
selected is red and let it equal 0 if the ith ball is blue, i = 1. To obtain a feeling for the 
joint probabilities of these X;, note the following special cases: 


P(X, =1,X2. = 1, X3 = 0,X4 = 1, X5 = 0} 
n n+1 m n+2 m+1 
“n+mntm+1intmt+2n4+m43n4+m+4 
n(n + 1)(n + 2)m(m + 1) 
~“nMtmntm+tDn+m+20n+m+3n+m+4 


and 
P{X, = 0, X2 = 1,X3 = 0,X4 = 1, X5 = 1} 
_ m n m+1 n+1 n+2 
“~n+mnt+tmtintm+2n4+m4+3n+m44 
_ n(n + 1)(n + 2)m(m + 1) 
nt mntmt+)Ynt+tm+2n+m+3\(n+m++4) 
By the same reasoning, for any sequence x1,...,x, that contains r ones and k — r 


zeros, we have 
P{X, = X4,...,Xk = Xk} 
_ n(n + 1)---(a+r— Imm 4+ 1)-:-(m+k—-—r-— i) 
- (nt+m)---(ntm+k-—1 


Therefore, for any value of k, the random variables X1,...,X; are exchangeable. 
An interesting corollary of the exchangeability in this model is that the probability 
that the ith ball selected is red is the same as the probability that the first ball selected 
is red, namely, -+,,. (For an intuitive argument for this initially nonintuitive result, 
imagine that all the m + m balls initially in the urn are of different types. That is, one 
is a red ball of type 1, one is a red ball of type 2, ..., one is a red ball type of n, one is 
a blue ball of type 1, and so on, down to the blue ball of type m. Suppose that when 
a ball is selected it is replaced along with another of its type. Then, by symmetry, the 
ith ball selected is equally likely to be of any of the n + m distinct types. Because n 
of these n + m types are red, the probability is —_.) | 


n+m~ 


Our final example deals with continuous random variables that are exchangeable. 


EXAMPLE 8d 


Let X1, X2,...,X;» be independent uniform (0, 1) random variables, and denote their 
order statistics by X(1),...,X(n). That is, Xj) is the jth smallest of X1,X2,...,Xn. 
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Also, let 


Yi = Xa, 
Y; = X(i) = X(j-1), i=2,...n 


Show that Y,,..., Y, are exchangeable. 
Solution. The transformations 
Yi = %41,---, Vi = Xi — Xj-1 b= 2eacaght 


yield 
Mi=Vr te: ty i=1,...,n 


As it is easy to see that the Jacobian of the preceding transformations is equal to 1, 
so, from Equation (7.3), we obtain 


Fj ¥u V1 nes Pn) =F AH Va PW bee Pa) 


where f is the joint density function of the order statistics. Hence, from Equation (6.1), 
we obtain that 


I alg Vi Vices Val = Ol 0 2 yy = yi Ye << ee ee ie 
or, equivalently, 


Mim¥s Odea an Oey <= LaHlensty Me bya = 1 


Because the preceding joint density is a symmetric function of y,..., Vn, we see that 
the random variables Y;,..., Y;, are exchangeable. | 
SUMMARY 


The joint cumulative probability distribution function of the pair of random variables 
X and Y is defined by 


Fa,y)=P{X = x,Y = y} — oO < x,y < oO 


All probabilities regarding the pair can be obtained from F. To find the individual 
probability distribution functions of X and Y, use 


Fy(x) = lim FQ@,y) Fy(y) = lim F(@,y) 
yoo X—> 00 


If X and Y are both discrete random variables, then their joint probability mass 
function is defined by 
pap) = Pix =LY=) 


The individual mass functions are 


PX=}=) pip PY ==> pap 
J I 


The random variables X and Y are said to be jointly continuous if there is a func- 
tion f(x, y), called the joint probability density function, such that for any two-dimensional 
set C, 


PUXY) eC) = | [fex.yyardy 
(es 
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It follows from the preceding formula that 
Pix < X <x+dx,y < Y < y + dy} & f(x,y) dxdy 


If X and Y are jointly continuous, then they are individually continuous with density 
functions 


jx) = / fa@ydy fyW= / ff, y) dx 


The random variables X and Y are independent if, for all sets A and B, 
P{X € A, Y € B} = P{X € A}P{Y € B} 


If the joint distribution function (or the joint probability mass function in the discrete 
case, or the joint density function in the continuous case) factors into a part depending 
only on x and a part depending only on y, then X and Y are independent. 

In general, the random variables X1,...,X; are independent if, for all sets of real 
numbers Aj,...,Ay, 


POG € Aj, CAD SPS CAs PIX ce AY 


If X and Y are independent continuous random variables, then the distribution func- 
tion of their sum can be obtained from the identity 


Pave / Fx(a — y)fr dy 


If Xj,i=1,...,n,are independent normal random variables with Tespeclve param: 
eters jz; ando?,i=1,...,n, then > Xj is normal with parameters y i; and % oa? 
i=1 =1 i=1 
If Xj,i=1,...,n, are inde pence Poisson random vanalss with respective param- 


eters 251 = 1,0,..57) thet 3 Xj is Poisson with parameter = Ni. 


=1 
If X and Y are discrete random variables, then the donadional probability mass 
function of X given that Y = y is defined by 


D(x,y) 
Py(y) 


where p is their joint probability mass function. Also, if X and Y are jointly continu- 
ous with joint density function f, then the conditional probability density function of 
X given that Y = y is given by 


P{X =x|Y=y}= 


fy) 
fy) 


The ordered values Xq) = X(2) = --- = Xm) of a set of independent and identically 
distributed random variables are called the order statistics of that set. If the random 
variables are continuous and have density function f, then the joint density function 
of the order statistics is 


fxiy@ly) = 


{Cia tn) SUP) ef On) Ay Zep = ay 
The random variables X1,...,X, are called exchangeable if the joint distribution of 
Xj,,+++,4X;, is the same for every permutation ,...,i, of 1,...,7 
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6.2. 


6.3. 


6.4. 


6.5. 


6.6. 


6.7. 


6.8. 


6.9. 


PROBLEMS 


Two fair dice are rolled. Find the joint probability 

mass function of X and Y when 

(a) X is the largest value obtained on any die and 
Y is the sum of the values; 

(b) X is the value on the first die and Y is the 
larger of the two values; 

(c) X is the smallest and Y is the largest value 
obtained on the dice. 

Suppose that 3 balls are chosen without replace- 

ment from an urn consisting of 5 white and 8 red 

balls. Let X; equal 1 if the ith ball selected is white, 

and let it equal 0 otherwise. Give the joint proba- 

bility mass function of 

(a) X1,X2; 

(b) X1,X2,X3. 

In Problem 2, suppose that the white balls are 

numbered, and let Y; equal 1 if the ith white ball is 

selected and 0 otherwise. Find the joint probability 

mass function of 

(a) Y1, Y2; 

(b) Yi, Yo, Y3. 

Repeat Problem 2 when the ball selected is 

replaced in the urn before the next selection. 

Repeat Problem 3a when the ball selected is 

replaced in the urn before the next selection. 

A bin of 5 transistors is known to contain 2 that 

are defective. The transistors are to be tested, one 

at a time, until the defective ones are identified. 

Denote by N, the number of tests made until the 

first defective is identified and by N2 the number of 

additional tests until the second defective is identi- 

fied. Find the joint probability mass function of Nj; 

and Np. 

Consider a sequence of independent Bernoulli tri- 

als, each of which is a success with probability p. 

Let X; be the number of failures preceding the 

first success, and let X2 be the number of failures 

between the first two successes. Find the joint mass 

function of X; and _X>. 

The joint probability density function of X and Y 

is given by 


f(x,y) = cy” — x*)e 


—ys=x=y,0<y<o 


(a) Find c. 

(b) Find the marginal densities of X and Y. 

(c) Find E[X]. 

The joint probability density function of X and Y 
is given by 

xy 


>) O<x<1,0<y<2 


ef 2 
foxy) =o (x + 2 
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6.11. 


6.12. 


6.13. 


6.14. 


6.15. 
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(a) Verify that this is indeed a joint density func- 
tion. 

Compute the density function of X. 

Find P{X > Y}. 

(d) Find P{Y > 4|X < 5}. 

(e) Find E[X]. 

(f) Find E[Y]. 

The joint probability density function of X and Y 
is given by 


(b) 
(c) 


f(x,y) =e Osx <w,05y <o 
Find (a) P(X < Y}and(b) P{X < a}. 

A television store owner figures that 45 percent of 
the customers entering his store will purchase an 
ordinary television set, 15 percent will purchase 
a plasma television set, and 40 percent will just 
be browsing. If 5 customers enter his store on 
a given day, what is the probability that he will 
sell exactly 2 ordinary sets and 1 plasma set on 
that day? 


The number of people that enter a drugstore in 
a given hour is a Poisson random variable with 
parameter A = 10. Compute the conditional prob- 
ability that at most 3 men entered the drugstore, 
given that 10 women entered in that hour. What 
assumptions have you made? 


A man and a woman agree to meet at a certain 
location about 12:30 P.M. If the man arrives at 
a time uniformly distributed between 12:15 and 
12:45, and if the woman independently arrives at 
a time uniformly distributed between 12:00 and 1 
P.M., find the probability that the first to arrive 
waits no longer than 5 minutes. What is the proba- 
bility that the man arrives first? 


An ambulance travels back and forth at a con- 
stant speed along a road of length L. At a certain 
moment of time, an accident occurs at a point uni- 
formly distributed on the road. [That is, the dis- 
tance of the point from one of the fixed ends of the 
road is uniformly distributed over (0, L).] Assum- 
ing that the ambulance’s location at the moment 
of the accident is also uniformly distributed, and 
assuming independence of the variables, compute 
the distribution of the distance of the ambulance 
from the accident. 


The random vector (X, Y) is said to be uniformly 
distributed over a region R in the plane if, for some 
constant c, its joint density is 


_ je if@y)eR 
fey) = f otherwise 
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6.17. 


6.18. 
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(a) Show that 1/c = area of region R. 

Suppose that (X, Y) is uniformly distributed over 

the square centered at (0, 0) and with sides of 

length 2. 

(b) Show that X and Y are independent, with 
each being distributed uniformly over (—1, 1). 

(c) What is the probability that (X, Y) lies in the 
circle of radius 1 centered at the origin? That 
is, find P(X? + Y? = 1}. 


Suppose that n points are independently chosen at 
random on the circumference of a circle, and we 
want the probability that they all lie in some semi- 
circle. That is, we want the probability that there is 
a line passing through the center of the circle such 
that all the points are on one side of that line, as 
shown in the following diagram: 


Let Pj,...,P, denote the n points. Let A denote 
the event that all the points are contained in some 
semicircle, and let A; be the event that all the 
points lie in the semicircle beginning at the point 
P; and going clockwise for 180°,i = 1,...,7. 

(a) Express A in terms of the Aj. 

(b) Are the A; mutually exclusive? 

(c) Find P(A). 


Three points X1,X2,X3 are selected at random 
on a line L. What is the probability that X> lies 
between X, and _X3? 


Two points are selected randomly on a line of 
length L so as to be on opposite sides of the mid- 
point of the line. [In other words, the two points 
X and Y are independent random variables such 
that X is uniformly distributed over (0, L/2) and 
Y is uniformly distributed over (L/2, L).] Find 
the probability that the distance between the two 
points is greater than L/3. 


Show that f(x,y) = 1/x,0 < y < x < 1,isajoint 
density function. Assuming that f is the joint den- 
sity function of X, Y, find 

(a) the marginal density of Y; 

(b) the marginal density of X; 

(c) E[X]; 


(c) E[Y]. 
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6.20. 


6.21. 


6.22. 


6.23. 


6.24, 


6.25. 


The joint density of X and Y is given by 
ew gs oy > 0 
fay) = f otherwise 


Are X and Y independent? If, instead, f(x, y) were 
given by 


_J2 O«<x<y,0<y<1 
IOV) = {0 otherwise 
would X and Y be independent? 
Let 


fixyy) =24xy O<x<1,0<5y<1,0<x+y<1 


and let it equal 0 otherwise. 

(a) Show that f(x, y) is a joint probability density 
function. 

(b) Find E[X]. 

(c) Find E[Y]. 

The joint density function of X and Y is 


O<x<1,0<y<1 
otherwise 


(a) Are X and Y independent? 

(b) Find the density function of X. 

(c) Find P{X¥ + Y < ]}. 

The random variables X and Y have joint density 
function 


f@,y)=12xyd — x) O<x<1,0<y<1 


and equal to 0 otherwise. 

(a) Are X and Y independent? 

(b) Find E[X]. 

(c) Find E[Y]. 

(d) Find Var(X). 

(e) Find Var(Y). 

Consider independent trials, each of which results 
in outcome 7,i = 0,1,...,k, with probability 


k 
Pi, >. pi = 1. Let N denote the number of trials 


i= 
needed to obtain an outcome that is not equal to 0, 
and let _X be that outcome. 


(a) Find P{N = n}j,n = 1. 

(b) Find P{X = j},7=1,...,k. 

(c) Show that P{N n,X R P{N 
n}P{X = j}. 

(d) Is it intuitive to you that N is independent 
of X? 

(e) Is it intuitive to you that X is independent 
of N? 

Suppose that 10° people arrive at a service station 


at times that are independent random variables, 


6.26. 


6.27. 


6.28. 


6.29. 


6.30. 


6.31. 


each of which is uniformly distributed over (0, 10°). 
Let N denote the number that arrive in the first 
hour. Find an approximation for P{N = i}. 


Suppose that A, B, C, are independent random 

variables, each being uniformly distributed over 

(0, 1). 

(a) What is the joint cumulative distribution func- 
tion of A, B, C? 

(b) What is the probability that all of the roots of 
the equation Ax? + Bx + C = Oare real? 


If X; and X2 are independent exponential ran- 
dom variables with respective parameters 4; and 
A2, find the distribution of Z = X1/X 2. Also com- 
pute P{X, < X}. 

The time that it takes to service a car is an expo- 
nential random variable with rate 1. 

(a) If A.J. brings his car in at time 0 and M. J. 
brings her car in at time f, what is the probabil- 
ity that M. J.’s car is ready before A. J.’s car? 
(Assume that service times are independent 
and service begins upon arrival of the car.) 

If both cars are brought in at time 0, with 
work starting on M. J.’s car only when A. J.’s 
car has been completely serviced, what is the 
probability that M.J.’s car is ready before 
time 2? 


(b) 


The gross weekly sales at a certain restaurant is 

a normal random variable with mean $2200 and 

standard deviation $230. What is the probabil- 

ity that 

(a) the total gross sales over the next 2 weeks 
exceeds $5000; 

(b) weekly sales exceed $2000 in at least 2 of the 
next 3 weeks? 

What independence assumptions have you made? 


Jill’s bowling scores are approximately normally 
distributed with mean 170 and standard deviation 
20, while Jack’s scores are approximately normally 
distributed with mean 160 and standard deviation 
15. If Jack and Jill each bowl one game, then 
assuming that their scores are independent ran- 
dom variables, approximate the probability that 
(a) Jack’s score is higher; 

(b) the total of their scores is above 350. 


According to the U.S. National Center for Health 

Statistics, 25.2 percent of males and 23.6 percent of 

females never eat breakfast. Suppose that random 

samples of 200 men and 200 women are chosen. 

Approximate the probability that 

(a) at least 110 of these 400 people never eat 
breakfast; 

(b) the number of the women who never eat 
breakfast is at least as large as the number of 
the men who never eat breakfast. 
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The expected number of typographical errors on a 
page of a certain magazine is .2. What is the prob- 
ability that an article of 10 pages contains (a) 0 and 
(b) 2 or more typographical errors? Explain your 
reasoning! 

The monthly worldwide average number of air- 
plane crashes of commercial airlines is 2.2. What 
is the probability that there will be 

(a) more than 2 such accidents in the next month? 
(b) more than 4 such accidents in the next 2 
months? 

more than 5 such accidents in the next 3 
months? 

Explain your reasoning! 

Jay has two jobs to do, one after the other. Each 
attempt at job 7 takes one hour and is successful 
with probability p;. If p, = .3 and pz = .4, what 
is the probability that it will take Jay more than 12 
hours to be successful on both jobs? 

In Problem 4, calculate the conditional probability 
mass function of X; given that 

(a) X2.=1; 

(b) X2 = 0. 

In Problem 3, calculate the conditional probability 
mass function of Y; given that 


(c) 


(a) Y2=1; 

(b) Y2 =0. 

In Problem 5, calculate the conditional probability 
mass function of Y; given that 

(a) Y2=1; 

(b) Y2 =0. 

Choose a number X at random from the set of 


numbers {1,2,3,4,5}. Now choose a number at 

random from the subset no larger than _X, that is, 

from {1,..., X}. Call this second number Y. 

(a) Find the joint mass function of X and Y. 

(b) Find the conditional mass function of X given 
that Y =7. Doit fori = 1,2,3,4,5. 

(c) Are X and Y independent? Why? 

Two dice are rolled. Let X¥ and Y denote, respec- 

tively, the largest and smallest values obtained. 

Compute the conditional mass function of Y given 

X = i, fori = 1,2,...,6. Are X and Y indepen- 

dent? Why? 


The joint probability mass function of X and Y is 
given by 
1 1 
1Lbj=-s 1,2) = — 
PLD=—5 MLZ 
1 1 
Jes >t 2,2 — 
Ma — PaaS 


(a) Compute the conditional mass function of X 
given Y =i,i= 1,2. 
(b) Are X and Y independent? 
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(c) Compute P{XY = 
P{X/Y > I}. 
The joint density function of X and Y is given by 


Px a Y & 2; 


fy) =xe7%OtD xs 0, y>0 


(a) Find the conditional density of X, given Y=y, 
and that of Y, given X = x. 

(b) Find the density function of Z = XY. 

The joint density of X and Y is 


fy) =c@? — y*)e* O=x<ow,-x=y=x 


Find the conditional distribution of Y, given 
X=x. 

An insurance company supposes that each per- 
son has an accident parameter and that the yearly 
number of accidents of someone whose accident 
parameter is A is Poisson distributed with mean i. 
They also suppose that the parameter value of a 
newly insured person can be assumed to be the 
value of a gamma random variable with param- 
eters s and a. If a newly insured person has n 
accidents in her first year, find the conditional den- 
sity of her accident parameter. Also, determine the 
expected number of accidents that she will have in 
the following year. 

If X,,X2,X3 are independent random variables 
that are uniformly distributed over (0, 1), com- 
pute the probability that the largest of the three 
is greater than the sum of the other two. 

A complex machine is able to operate effectively 
as long as at least 3 of its 5 motors are functioning. 
If each motor independently functions for a ran- 
dom amount of time with density function f(x) = 
xe~*,x > 0, compute the density function of the 
length of time that the machine functions. 

If 3 trucks break down at points randomly dis- 
tributed on a road of length L, find the probability 
that no 2 of the trucks are within a distance d of 
each other whend = L/2. 

Consider a sample of size 5 from a uniform distri- 


bution over (0, 1). Compute the probability that 


the median is in the interval (i 3 : 


If X41, X2,X3,X4,X5 are independent and iden- 
tically distributed exponential random variables 
with the parameter A, compute 


(a) P{min(X),...,X5) = a}; 
(b) P{max(Xy,...,X5) = a}. 
Let Xq),X(2),---,X(1) be the order statistics 


of a set of m independent uniform (0,1) random 
variables. Find the conditional distribution of X(,) 
given that Xq) = s1,X2) = 82,...,X~m-1) = 
Sy—1- 
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6.50. Let Z,; and Zz be independent standard normal 


random variables. Show that _X, Y has a bivariate 
normal distribution when XY = Z1, Y= Z, + Zo. 


6.51. Derive the distribution of the range of a sample of 


6.52. 


6.53. 


6.54. 


6.55. 


6.56. 


6.57. 


6.58. 


6.59. 


size 2 from a distribution having density function 
f(x) =2x,0 <x <1. 

Let X and Y denote the coordinates of a point uni- 
formly chosen in the circle of radius 1 centered at 
the origin. That is, their joint density is 


1 
fey=— ety sl 

1 
Find the joint density function of the polar coordi- 
nates R = (X2 + Y2)!/2 and © = tan! Y/X. 
If X and Y are independent random variables 
both uniformly distributed over (0, 1), find the 
joint density function of R = /X2 + Y?2,0 = 
tan! Y/X. 
If U is uniform on (0,22) and Z, independent of 
U, is exponential with rate 1, show directly (with- 
out using the results of Example 7b) that XY and Y 
defined by 


X = V2ZcosU 
Y=vV2ZsinU 


are independent standard normal random vari- 
ables. 


X and Y have joint density function 
1 
FRY) = asa eae ee eae 
xy 


(a) Compute the joint density function of U = 
XY,V=X/Y. 

(b) What are the marginal densities? 

If X and Y are independent and identically dis- 

tributed uniform random variables on (0, 1), 

compute the joint density of 

(a) U=X4+ Y,V=X/Y; 

(b) U=X,V=X/Y; 

(:) U=X+ Y,V=X/(X + Y). 

Repeat Problem 6.56 when X and Y are inde- 

pendent exponential random variables, each with 

parameter A = 1. 

If X; and X2 are independent exponential random 

variables, each having parameter 4, find the joint 

density function of Y; = X; + X2 and Y2 = el, 

If X, Y, and Z are independent random variables 

having identical density functions f(x) = e~*,0 < 

x < oo, derive the joint distribution of U = X + 

Y,VHX+2Z2,W=Y 4 Z. 
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k 
In Example 8b, let Yx44 =n + 1 — ¥> Y;. Show 


i=l 
that Yj,..., Yx, Y¥x41 are exchangeable. Note that 
Yx41 is the number of balls one must observe to 
obtain a special ball if one considers the balls in 
their reverse order of withdrawal. 


6.61. 


Theoretical Exercises 291 


Consider an urn containing n balls numbered 
1,...,, and suppose that k of them are randomly 
withdrawn. Let X; equal 1 if ball number i is 
removed and let X; be 0 otherwise. Show that 
X1,...,Xn are exchangeable. 


THEORETICAL EXERCISES 


Verify Equation (1.2). 

Suppose that the number of events occurring in 
a given time period is a Poisson random vari- 
able with parameter 4. If each event is classi- 
fied as a type i event with probability pj,i = 
1,...,n, > pi = 1, independently of other events, 
show that the numbers of type 7 events that occur, 
i=1,...,n, are independent Poisson random vari- 
ables with respective parameters Ap;, i= 1,...,n. 
Suggest a procedure for using Buffon’s needle 
problem to estimate z. Surprisingly enough, this 
was once a common method of evaluating z. 
Solve Buffon’s needle problem when L > D. 


ANSWER: meee | — sing) + 26/2, where cosé = 
D/L. 

If X and Y are independent continuous positive 
random variables, express the density function of 
(a) Z = X/Y and (b) Z = XY in terms of the 
density functions of X and Y. Evaluate the density 
functions in the special case where X and Y are 
both exponential random variables. 

If X and Y are jointly continuous with joint density 
function fy y(x, y), show that XY + Y is continuous 
with density function 


fxry@ -|/ fxy(x,t — x) dx 


(a) If X has a gamma distribution with parame- 
ters (t, A), what is the distribution of cX,c > 0? 
(b) Show that 
1 
a Kin 
has a gamma distribution with parameters n, » 
when n is a positive integer and % is a 
chi-squared random variable with 2n degrees 
of freedom. 
Let X and Y be independent continuous ran- 
dom variables with respective hazard rate func- 
tions A(t) and Ay(t), and set W = min(X, Y). 
(a) Determine the distribution function of W in 
terms of those of X and Y. 
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(b) Show that Aw(t), the hazard rate function of 
W, is given by 


Awl) =Ax(t) + ay(t) 


Let X1,...,X, be independent exponential ran- 
dom variables having a common parameter i. 
Determine the distribution of min(Xj,...,Xy). 


The lifetimes of batteries are independent expo- 
nential random variables, each having parame- 
ter 4. A flashlight needs 2 batteries to work. If one 
has a flashlight and a stockpile of n batteries, what 
is the distribution of time that the flashlight can 
operate? 


Let X1, X2, X3, X4, X5 be independent continu- 
ous random variables having a common distribu- 
tion function F and density function f, and set 


LT=P{X, < X2 < X3 < X4 < Xs} 


(a) Show that J does not depend on F. 

Hint: Write I as a five-dimensional integral and 

make the change of variables uj = F(xj),i = 

Ul schlag Oe 

(b) Evaluate /. 

(c) Give an intuitive explanation for your answer 
to (b). 


Show that the jointly continuous (discrete) ran- 
dom variables Xj,...,X;, are independent if and 
only if their joint probability density (mass) func- 


tion f(x1,...,Xn) can be written as 
n 
Pics. = [la 
i=1 
for nonnegative functions gj(x),i=1,...,n. 
In Example 5c we computed the conditional den- 


sity of a success probability for a sequence of tri- 
als when the first n + m trials resulted in n suc- 
cesses. Would the conditional density change if 
we specified which n of these trials resulted in 
successes? 
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Suppose that _X and Y are independent geometric 

random variables with the same parameter p. 

(a) Without any computations, what do you think 
is the value of 


P(X =i|X + Y=n}? 


Hint: Imagine that you continually flip a coin hav- 
ing probability p of coming up heads. If the second 
head occurs on the nth flip, what is the probability 
mass function of the time of the first head? 

(b) Verify your conjecture in part (a). 

Consider a sequence of independent trials, with 
each trial being a success with probability p. Given 
that the Ath success occurs on trial n, show that 
all possible outcomes of the first n — 1 trials that 
consist of k — 1 successes andn — k failures are 
equally likely. 

If X and Y are independent binomial random 
variables with identical parameters n and p, show 
analytically that the conditional distribution of X 
given that X + Y = mis the hypergeometric dis- 
tribution. Also, give a second argument that yields 
the same result without any computations. 

Hint: Suppose that 2n coins are flipped. Let X 
denote the number of heads in the first n flips and 
Y the number in the second n flips. Argue that 
given a total of m heads, the number of heads in 
the first 1 flips has the same distribution as the 
number of white balls selected when a sample of 
size m is chosen from n white and n black balls. 
Suppose that X;,i = 1,2,3 are independent Pois- 
son random variables with respective means j,i = 
1,2,3. Let X = X; + X2 and Y = X2 + X;3. 
The random vector X, Y is said to have a bivari- 
ate Poisson distribution. Find its joint probability 
mass function. That is, find PLY =n, Y =m}. 
Suppose X and Y are both integer-valued random 
variables. Let 


pal) = P(x =iY =p 


and 
qgl) = PY = )|X =D 
Show that 
PX=tv=p7=— ue 
di quo) 


Let X1, X2, X3 be independent and identically dis- 
tributed continuous random variables. Compute 
(a) P{X, > X2|X1 > X3}; 

(b) P{X, > X2|X1 
(c) P{X, > X2|X2 
(d) P{X, > X2|X2 
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Let U denote a random variable uniformly dis- 
tributed over (0, 1). Compute the conditional dis- 
tribution of U given that 

(a) U>a; 

(b) U <a; 

where 0 < a < 1. 

Suppose that W, the amount of moisture in the 
air on a given day, is a gamma random vari- 
able with parameters (f, 8). That is, its density is 
fiw) = Be" (pw)!/T(), w > 0. Suppose also 
that given that W = w, the number of accidents 
during that day—call it N—has a Poisson distribu- 
tion with mean w. Show that the conditional dis- 
tribution of W given that N = n is the gamma 
distribution with parameters (t + n,6 + 1). 

Let W be a gamma random variable with param- 
eters (¢,6), and suppose that conditional on 
W = w,X1,X2,...,Xn are independent exponen- 
tial random variables with rate w. Show that the 
conditional distribution of W given that X; = 
x1,X2 = x2,...,Xn = Xp, is gamma with parame- 


n 
ters (: +n,B + ¥0x;}. 
i=1 

A rectangular array of mn numbers arranged in n 
rows, each consisting of m columns, is said to con- 
tain a saddlepoint if there is a number that is both 
the minimum of its row and the maximum of its 
column. For instance, in the array 


1 a: 2 
0 -—2 6 
5S 12 3 


the number 1 in the first row, first column is a 
saddlepoint. The existence of a saddlepoint is of 
significance in the theory of games. Consider a 
rectangular array of numbers as described previ- 
ously and suppose that there are two individuals— 
A and B—that are playing the following game: A 
is to choose one of the numbers 1,2,...,n and B 
one of the numbers 1,2,...,7. These choices are 
announced simultaneously, and if A chose i and 
B chose j, then A wins from B the amount spec- 
ified by the number in the ith row, jth column of 
the array. Now suppose that the array contains 
a saddlepoint—say the number in the row r and 
column k—call this number x,;. Now if player A 
chooses row , then that player can guarantee her- 
self a win of at least x, (since x,, is the minimum 
number in the row r). On the other hand, if player 
B chooses column k, then he can guarantee that he 
will lose no more than x,, (since x;x is the maxi- 
mum number in the column k). Hence, as A has a 
way of playing that guarantees her a win of x,, and 
as B has a way of playing that guarantees he will 
lose no more than x,x, it seems reasonable to take 
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these two strategies as being optimal and declare 
that the value of the game to player A is x;x. 

If the nm numbers in the rectangular array 
described are independently chosen from an 
arbitrary continuous distribution, what is the 
probability that the resulting array will contain a 
saddle-point? 

If X is exponential with rate A, find P{LX] =n, X — 
[X] = x}, where [+] is defined as the largest integer 
less than or equal to x. Can you conclude that [X] 
and X — [X] are independent? 

Suppose that F(x) is a cumulative distribution 
function. Show that (a) F”(x) and (b) 1 — [1 — 
F(x)]" are also cumulative distribution functions 
when n is a positive integer. 

Hint: Let X1,..., Xp» be independent random vari- 
ables having the common distribution function F. 
Define random variables Y and Z in terms of the 
X; so that P{Y = x} = F"(x) and P{Z = x} = 
1 — [1 — F(x)]". 

Show that if n people are distributed at random 
along aroad L miles long, then the probability that 
no 2 people are less than a distance D miles apart 
is when D = L/(n — 1), [1 — (n — 1)D/L]". What 
ifD > L/(n — 1)? 

Establish Equation (6.2) by differentiating Equa- 
tion (6.4). 

Show that the median of a sample of size 2n + 1 
from a uniform distribution on (0, 1) has a beta 
distribution with parameters (n + 1,n + 1). 
Verify Equation (6.6), which gives the joint density 
of X (i) and Xj). 

Compute the density of the range of a sample of 
size n from a continuous distribution having den- 
sity function f. 

Let Xq) = XQ) =--: = Xn) be the ordered values 
of n independent uniform (0, 1) random variables. 
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Prove that forl =k sn +1, 
P{X (x) _ X(k-1) > t} = (1 _ ty” 


where Xo) = 0, X(n41) = t. 

Let X1,...,X, be a set of independent and identi- 
cally distributed continuous random variables hav- 
ing distribution function F, and let X(),i=1,...,n 
denote their ordered values. If X, independent of 
the X;,i = 1,...,n, also has distribution F’,, deter- 
mine 

(a) P{X > X ny}; 

(b) P{X > Xa}; 

(ce) PiXw < X < Xpjlsi<jsn. 

Let X1,...,Xn be independent and identically 
distributed random variables having distribution 
function F and density f. The quantity M = LX) + 
X(n)|/2, defined to be the average of the small- 
est and largest values in Xj,..., Xn, is called the 
midrange of the sequence. Show that its distribu- 
tion function is 


Fyu(m) =n [Fm — x) — F(x)" 'f@ dx 


Let X1,...,X;, be independent uniform (0, 1) ran- 
dom variables. Let R = X(n) — X (1) denote the 
range and M = [Xj + Xq)]/2 the midrange of 
X1,...,Xn. Compute the joint density function of 
Rand M. 

If X and Y are independent standard normal ran- 
dom variables, determine the joint density func- 


tion of ¥ 
U=X V= = 
Y 
Then use your result to show that X/Y has a 
Cauchy distribution. 


SELF-TEST PROBLEMS AND EXERCISES 


Each throw of an unfair die lands on each of the 
odd numbers 1, 3, 5 with probability C and on each 
of the even numbers with probability 2C. 

(a) Find C. 

(b) Suppose that the die is tossed. Let XY equal 
1 if the result is an even number, and let it 
be 0 otherwise. Also, let Y equal 1 if the 
result is a number greater than three and 
let it be 0 otherwise. Find the joint prob- 
ability mass function of X and Y. Suppose 
now that 12 independent tosses of the die are 
made. 

(c) Find the probability that each of the six out- 
comes occurs exactly twice. 
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(d) Find the probability that 4 of the outcomes 
are either one or two, 4 are either three or 
four, and 4 are either five or six. 

(e) Find the probability that at least 8 of the 
tosses land on even numbers. 

The joint probability mass function of the random 

variables X, Y, Z is 


1 
pd, 2,3) = p(2,1,1) = p(2,2,1) = p(2,3,2) = 4 


Find (a) E[XYZ], and (b) E[XY + XZ + YZ]. 
The joint density of X and Y is given by 
f(x,y) = Cy — xe 


—-y<x<y, 0<y<o 
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(a) Find C. 

(b) Find the density function of X. 

(c) Find the density function of Y. 

(d) Find E[X]. 

(e) Find E[Y]. 

Letr =r, +... + rx, where all 7; are positive 
integers. Argue that if X1,...,X;, has a multino- 


mial distribution, then so does Yj,..., Y; where, 
with ro = 0, 
Rati 
Ye. > 2p. 228 
j=rj-itl 


That is, Y; is the sum of the first r; of the X’s, Y2 
is the sum of the next r2, and so on. 

Suppose that X, Y, and Z are independent random 
variables that are each equally likely to be either 
1 or 2. Find the probability mass function of (a) 
XYZ, (b) XY + XZ + YZ, and (c) X? + YZ. 


Let X and Y be continuous random variables with 
joint density function 
ae 0 11 5 
= cy <x<lil<y< 
fy) = 45 
0 otherwise 


where c is a constant. 

(a) What is the value of c? 

(b) Are X and Y independent? 

(c) Find P{X¥ + Y > 3}. 

The joint density function of X and Y is 


O<x<1,0<y<2 
otherwise 


xy 
f(x, y) = {i 

(a) Are X and Y independent? 
(b) Find the density function of X. 
(c) Find the density function of Y. 
(d) Find the joint distribution function. 
(e) Find E[Y]. 
(f) Find P(X + Y < 1}. 
Consider two components and three types of 
shocks. A type 1 shock causes component 1 to fail, 
a type 2 shock causes component 2 to fail, and a 
type 3 shock causes both components 1 and 2 to 
fail. The times until shocks 1, 2, and 3 occur are 
independent exponential random variables with 
respective rates A1,42, and A3. Let Xj; denote the 
time at which component i fails, i = 1,2. The 
random variables X;, X2 are said to have a joint 
bivariate exponential distribution. Find P{X; > 
s,X2 > th. 
Consider a directory of classified advertisements 
that consists of m pages, where m is very large. 
Suppose that the number of advertisements per 


Jointly Distributed Random Variables 


6.10. 


page varies and that your only method of finding 
out how many advertisements there are on a spec- 
ified page is to count them. In addition, suppose 
that there are too many pages for it to be feasi- 
ble to make a complete count of the total num- 
ber of advertisements and that your objective is 
to choose a directory advertisement in such a way 
that each of them has an equal chance of being 
selected. 

(a) If you randomly choose a page and then 
randomly choose an advertisement from that 
page, would that satisfy your objective? Why 
or why not? 

Let n(i) denote the number of advertise- 
ments on page i,i = 1,...,m, and suppose 
that whereas these quantities are unknown, 
we can assume that they are all less than 
or equal to some specified value n. Con- 
sider the following algorithm for choosing an 
advertisement. 


Step 1. Choose a page at random. Suppose it is 
page X. Determine n(X) by counting the 
number of advertisements on page X. 
“Accept” page X with probability n(X)/n. 
If page X is accepted, go to step 3. Other- 
wise, return to step 1. 

Randomly choose one of the advertise- 
ments on page X. 


Step 2. 


Step 3. 


Call each pass of the algorithm through step 
1 an iteration. For instance, if the first ran- 
domly chosen page is rejected and the second 
accepted, than we would have needed 2 itera- 
tions of the algorithm to obtain an advertise- 
ment. 

What is the probability that a single iteration 
of the algorithm results in the acceptance of 
an advertisement on page i? 

What is the probability that a single iteration 
of the algorithm results in the acceptance of 
an advertisement? 

What is the probability that the algorithm 
goes through k iterations, accepting the jth 
advertisement on page i on the final iteration? 
What is the probability that the jth advertise- 
ment on page / is the advertisement obtained 
from the algorithm? 

What is the expected number of iterations 
taken by the algorithm? 


(b) 


(c) 


(d) 


(e) 


(f) 


The “random” parts of the algorithm in Self-Test 
Problem 8 can be written in terms of the generated 
values of a sequence of independent uniform (0, 
1) random variables, known as random numbers. 
With [x] defined as the largest integer less than or 
equal to x, the first step can be written as follows: 


Step 1. Generate a uniform (0, 1) random variable U. 
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- Let X1,X,.. 


Let X = [mU] + 1, and determine the value of 
n(x). 


(a) Explain why the above is equivalent to step 1 
of Problem 8. 

Hint: What is the probability mass function of X? 

(b) Write the remaining steps of the algorithm in 
a similar style. 

. be a sequence of independent uni- 

form (0, 1) random variables. For a fixed con- 

stant c, define the random variable N by 


N=min{n: X, > c} 


Is N independent of Xj)? That is, does know- 
ing the value of the first random variable that is 
greater than c affect the probability distribution of 
when this random variable occurs? Give an intu- 
itive explanation for your answer. 

The accompanying dartboard is a square whose 
sides are of length 6: 


10 
20 


The three circles are all centered at the center of 
the board and are of radii 1, 2, and 3, respectively. 
Darts landing within the circle of radius 1 score 30 
points, those landing outside this circle, but within 
the circle of radius 2, are worth 20 points, and 
those landing outside the circle of radius 2, but 
within the circle of radius 3, are worth 10 points. 
Darts that do not land within the circle of radius 
3 do not score any points. Assuming that each 
dart that you throw will, independently of what 
occurred on your previous throws, land on a point 
uniformly distributed in the square, find the prob- 
abilities of the accompanying events: 
(a) You score 20 on a throw of the dart. 
(b) You score at least 20 on a throw of the 
dart. 
(c) You score 0 on a throw of the dart. 
(d) The expected value of your score on a throw 
(e) 


of the dart. 

Both of your first two throws score at least 10. 
(f) Your total score after two throws is 30. 
A model proposed for NBA basketball supposes 
that when two teams with roughly the same record 
play each other, the number of points scored in 
a quarter by the home team minus the number 
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scored by the visiting team is approximately a nor- 

mal random variable with mean 1.5 and variance 

6. In addition, the model supposes that the point 

differentials for the four quarters are independent. 

Assume that this model is correct. 

(a) What is the probability that the home team 
wins? 

(b) What is the conditional probability that the 
home team wins, given that it is behind by 5 
points at halftime? 

(c) What is the conditional probability that the 
home team wins, given that it is ahead by 5 
points at the end of the first quarter? 


Let N be a geometric random variable with param- 
eter p. Suppose that the conditional distribution 
of X given that N = n is the gamma distribu- 
tion with parameters n and i. Find the condi- 
tional probability mass function of N given that 
xX =x. 


Let X and Y be independent uniform (0, 1) ran- 

dom variables. 

(a) Find the joint densityof U=X,V=X + Y. 

(b) Use the result obtained in part (a) to compute 
the density function of V. 


You and three other people are to place bids for an 
object, with the high bid winning. If you win, you 
plan to sell the object immediately for 10 thousand 
dollars. How much should you bid to maximize 
your expected profit if you believe that the bids 
of the others can be regarded as being indepen- 
dent and uniformly distributed between 7 and 11 
thousand dollars? 


Find the probability that X,, X2,...,Xn is a per- 

mutation of 1,2,...,n, when X),X2,...,X, are 

independent and 

(a) each is equally likely to be any of the values 
1 ey 7 

(b) each has the probability mass function P{X; = 
J=ppj=,...,n. 

Let X1,...,X, and Yj,..., Y, be independent ran- 

dom vectors, with each vector being a random 

ordering of k ones andn — k zeroes. That is, their 

joint probability mass functions are 


P{X=h,...,Xn=in}=P(Y1=hh,..-, Yn= in} 
1 n 
=~, = 0,1 — 
a j oi, dil k 
k = 
Let 


n 
N=)01% — Yi 
i=1 
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denote the number of coordinates at which the two 
vectors have different values. Also, let M denote 
the number of values of i for which X; = 1, Y; = 0. 
(a) Relate N to M. 

(b) What is the distribution of M? 

(c) Find E[N]. 

(d) Find Var(N). 

Let Z1,Z2,...,Z, be independent standard nor- 
mal random variables, and let 


Jointly Distributed Random Variables 


6.20. 


(a) What is the conditional distribution of S, 
given that S$; = y, fork =1,...,n? 

(b) Show that, for 1 = k = n, the conditional 
distribution of S, given that S, = x is 
normal with mean xk/n and variance k(n — 
k)/n. 


Let X1, X2,... be a sequence of independent and 
identically distributed continuous random vari- 
ables. Find 

(a) P{X6 > X4|X1, = max(Xj,.. 
(b) P{X_ > X2|X1, = max(Xq,.. 


eg X5)} 
.,X5)} 
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INTRODUCTION 

EXPECTATION OF SUMS OF RANDOM VARIABLES 
MOMENTS OF THE NUMBER OF EVENTS THAT OCCUR 
COVARIANCE, VARIANCE OF SUMS, AND CORRELATIONS 
CONDITIONAL EXPECTATION 

CONDITIONAL EXPECTATION AND PREDICTION 

MOMENT GENERATING FUNCTIONS 

ADDITIONAL PROPERTIES OF NORMAL RANDOM VARIABLES 
GENERAL DEFINITION OF EXPECTATION 


7.1 


INTRODUCTION 


In this chapter, we develop and exploit additional properties of expected values. To 
begin, recall that the expected value of the random variable X is defined by 


E[X] = > xp) 
x 
where X is a discrete random variable with probability mass function p(x), and by 


E[X] = [- xf (x) dx 


when X is a continuous random variable with probability density function f(x). 
Since E/X7 is a weighted average of the possible values of X, it follows that if X 
must lie between a and b, then so must its expected value. That is, if 


Pla<X <bj=1 


then 
a= E[X] <b 


To verify the preceding statement, suppose that X is a discrete random variable for 
which P{a = X = b} = 1. Since this implies that p(x) = 0 for all x outside of the 
interval [a, b], it follows that 


E[X]= S) xp@ 


x:p(x)>0 


= So aptx) 


xip(x)>0 
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=a ype 


xip(x)>0 


=a 


In the same manner, it can be shown that E[X] S b, so the result follows for discrete 
random variables. As the proof in the continuous case is similar, the result follows. 


7.2 EXPECTATION OF SUMS OF RANDOM VARIABLES 


For a two-dimensional analog of Propositions 4.1 of Chapter 4 and 2.1 of Chapter 5, 
which give the computational formulas for the expected value of a function of a ran- 
dom variable, suppose that XY and Y are random variables and g is a function of two 
variables. Then we have the following result. 


Proposition 2.1. If X and Y have a joint probability mass function p(x,y), then 


E[g(X,¥)] =) Yo ge. y)px.y) 
y x 
If X and Y have a joint probability density function f(x,y), then 


E[g(X, Y)] = / i g(x, y)f (x, y) dx dy 


Let us give a proof of Proposition 2.1 when the random variables X and Y are 
jointly continuous with joint density function f(x, y) and when g(X, Y) is a nonneg- 
ative random variable. Because g(X, Y) = 0, we have, by Lemma 2.1 of Chapter 5, 


that . 
ElgX.¥I]= fo PlexX.¥) > at 
0 
Writing 
P{g(X,Y) > = / i flx,y) dy dx 
(y):g@y)>t 
shows that 


Ele(X, ¥)] = / / / Hep aplacte 
0 (x,y):g(x.y)>t 


Interchanging the order of integration gives 
g(x,y) 
EIgx.¥) =f ff f(x,y) dt dy dx 
x Jy Jt=0 


=| [ sensory ayax 
xdy 


Thus, the result is proven when g(X, Y) is a nonnegative random variable. The gen- 
eral case then follows as in the one-dimensional case. (See Theoretical Exercises 2 
and 3 of Chapter 5.) 


EXAMPLE 2a 


An accident occurs at a point X that is uniformly distributed on a road of length L. 
At the time of the accident, an ambulance is at a location Y that is also uniformly 
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distributed on the road. Assuming that X and Y are independent, find the expected 
distance between the ambulance and the point of the accident. 


Solution. We need to compute _ — Y|]. Since the joint density function of X and 
Y is 
fy) = o O<x<L, O<y<L 


it follows from Proposition 2.1 that 


i ds iL 
EX - Y= f 7 kx — yldydx 


Now, 
L x b 
/ Ix — yidy = [ (x — y)dy + / (y — x)dy 
0 0 x 
x2 L2 x2 
= | Li 
ae ge 
L2 
= > + x — xL 
Therefore, 
1 fof P 
E[|\X — Y\|]= af ( 5 + x «) dx 
L 
== | 
3 


For an important application of Proposition 2.1, suppose that ELX] and E[Y] are 
both finite and let g(X, Y) = X + Y. Then, in the continuous case, 


E[X + Y]= [- ih (x + y)f(x, y) dx dy 


=i [ xf (x,y) dy dx + [ iz yf (x, y) dx dy 


= [- xfx (x) dx + a yfy(y) dy 
—0o —oo 

= E[X] + E[Y] 

The same result holds in general; thus, whenever ELX] and E[Y] are finite, 
E[X + Y]= E[X] + E[Y] (2.1) 
EXAMPLE 2b 
Suppose that, for random variables X and Y, 
X=Y 


That is, for any outcome of the probability experiment, the value of the random vari- 
able X is greater than or equal to the value of the random variable Y. Since x = y is 
equivalent to the inequality X¥ — Y = 0, it follows that E[X — Y]=0, or, equivalently, 


E[X] = E[Y] a 
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Using Equation (2.1), we may show by a simple induction proof that if ELX;] is 
finite for alli = 1,...,n, then 


E[X, + ++» + Xp] = ELM] + --- + ELXn) (2.2) 


Equation (2.2) is an extremely useful formula whose utility will now be illustrated by 
a series of examples. 


EXAMPLE 2c The sample mean 


Let X1,...,Xn be independent and identically distributed random variables having 
distribution function F and expected value jz. Such a sequence of random variables is 
said to constitute a sample from the distribution F. The quantity 


n 
= Xj 
Am 2 
i=1 


is called the sample mean. Compute E[X]. 


Solution. 


E[X]=E| > 


i=1 
1 n 
=—E ze 
= 


1S” FIX 
i=l] 


=m since ELX;| = uw 


That is, the expected value of the sample mean is jw, the mean of the distribution. 
When the distribution mean y is unknown, the sample mean is often used in statistics 
to estimate it. | 


EXAMPLE 2d Boole’s inequality 


Let Aj,..., An denote events, and define the indicator variables Xj,i = 1,...,n, by 


a 1 if A; occurs 
'“~)0 otherwise 


Let 
n 
x= s XxX; 
i=1 


so X denotes the number of the events A; that occur. Finally, let 


Y= 1 fxX=1 
“10 otherwise 
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so Y is equal to 1 if at least one of the A; occurs and is 0 otherwise. Now, it is imme- 
diate that 


X2=Y 
so 
E[X] = E[Y] 
But since Ch Ch 
E[X] = 0 E[Xi] = 9 P(Ad) 
i=1 i=1 
and 


n 
E[Y] = P{at least one of the A; occur} = P U Aj 
i=l 


we obtain Boole’s inequality, namely, 
n n 
P|JAi] = )o Pd a 
i=1 i=1 


The next three examples show how Equation (2.2) can be used to calculate the 
expected value of binomial, negative binomial, and hypergeometric random vari- 
ables. These derivations should be compared with those presented in Chapter 4. 
EXAMPLE 2e Expectation of a binomial random variable 


Let X be a binomial random variable with parameters n and p. Recalling that such 
a random variable represents the number of successes in n independent trials when 
each trial has probability p of being a success, we have that 


Ka tae 
where 


ye 1 if the 7th trial is a success 
‘“ )0 if the ith trial is a failure 


Hence, Xj is a Bernoulli random variable having expectation ELX;] = 1(p) + 001 — 
p). Thus, 
E[|X] = E[X1] + E[Xo] + --- + ELX,] = np | 


EXAMPLE 2f Mean of a negative binomial random variable 


If independent trials having a constant probability p of being successes are performed, 
determine the expected number of trials required to amass a total of r successes. 


Solution. If X denotes the number of trials needed to amass a total of r successes, 
then_X is a negative binomial random variable that can be represented by 


X=X + +--+, 


where Xj is the number of trials required to obtain the first success, X2 the number 
of additional trials until the second success is obtained, X3 the number of additional 
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trials until the third success is obtained, and so on. That is, X; represents the num- 
ber of additional trials required after the (i — 1)st success until a total of i successes 
is amassed. A little thought reveals that each of the random variables X; is a geo- 
metric random variable with parameter p. Hence, from the results of Example 8b of 
Chapter 4, ELX;] = 1/p,i=1,2,...,r; thus, 


E[X] = E[X\] + --» + ELX,] = 7 


EXAMPLE 2g Mean of a hypergeometric random variable 


If n balls are randomly selected from an urn containing N balls of which m are white, 
find the expected number of white balls selected. 


Solution. Let X denote the number of white balls selected, and represent X as 


X= Xj a + Xm 


where 
Y= 1 if the ith white ball is selected 
'“)0 otherwise 
Now 
E[X;] = P(X; = 1} 
= P{ith white ball is selected} 
1 N-1 
1 n—1 
- N 
n 
on 
oN 
Hence, 
mn 
E[X] = ELM] +--+: + E[Xn] = W 


We could also have obtained the preceding result by using the alternative represen- 
tation 


X=Y,4+-:-+ Vy 
where 
1 if the ith ball selected is white 
Y;= : 
0 otherwise 


Since the ith ball selected is equally likely to be any of the N balls, it follows that 


E[Y¥i] = y 
so a 
EX] = E[Y,] tose Hp E[Yn]| =— (i) 
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EXAMPLE 2h Expected number of matches 


Suppose that N people throw their hats into the center of a room. The hats are mixed 
up, and each person randomly selects one. Find the expected number of people that 
select their own hat. 


Solution. Letting X denote the number of matches, we can compute E[X] most eas- 
ily by writing 
X=X, + X.+-:-+ Xy 
where 
1 ‘if the ith person selects his own hat 
Xi = . 
0 otherwise 


Since, for each i, the ith person is equally likely to select any of the N hats, 


E[X)| = P(X) = 1) = — 


N 
Thus, 
il 
E[X] = E[X{] + --- + E[Xy] = (=)N=1 
Hence, on the average, exactly one person selects his own hat. | 


EXAMPLE 2i Coupon-collecting problems 


Suppose that there are N different types of coupons, and each time one obtains a 
coupon, it is equally likely to be any one of the N types. Find the expected number of 
coupons one need amass before obtaining a complete set of at least one of each type. 


Solution. Let X denote the number of coupons collected before a complete set is 
attained. We compute E[X’] by using the same technique we used in computing the 
mean of a negative binomial random variable (Example 2f). That is, we define Xj, i = 
0,1,...,N — 1 to be the number of additional coupons that need be obtained after 
i distinct types have been collected in order to obtain another distinct type, and we 
note that 

X= XG AY ests + AN 


When i distinct types of coupons have already been collected, a new coupon obtained 
will be of a distinct type with probability (NV — i)/N. Therefore, 


N-i = k-1 
PUX; =k = (x) k=1 


or, in other words, X; is a geometric random variable with parameter (N — i)/N. 
Hence, 


implying that 
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EXAMPLE 2j 


Ten hunters are waiting for ducks to fly by. When a flock of ducks flies overhead, the 
hunters fire at the same time, but each chooses his target at random, independently 
of the others. If each hunter independently hits his target with probability p, com- 
pute the expected number of ducks that escape unhurt when a flock of size 10 flies 
overhead. 


Solution. Let X; equal 1 if the ith duck escapes unhurt and 0 otherwise, for i = 1, 
2,...,10. The expected number of ducks to escape can be expressed as 


E[X, +--+ + X19] = ELM] + --- + E[Xi0] 


To compute ELX;] = P{X; = 1}, we note that each of the hunters will, independently, 
hit the ith duck with probability p/10, so 


10 
Peas (1 = r) 


Hence, 


EXAMPLE 2k Expected number of runs 


Suppose that a sequence of n 1’s and m 0’s is randomly permuted so that each of the 
(n + m)!/(n!m!) possible arrangements is equally likely. Any consecutive string of 1’s 
is said to constitute a run of 1’s—for instance, if n = 6,m = 4, and the ordering is 1, 
1, 1,0, 1,1, 0, 0, 1, 0, then there are 3 runs of 1’s—and we are interested in computing 
the mean number of such runs. To compute this quantity, let 


Pires 1 ifarun of 1’s starts at the ith position 
‘“~ ]0 otherwise 


Therefore, R(1), the number of runs of 1, can be expressed as 
n+m 


RQ) = De i 


and it follows that 


n+m 


E[R)] = 0 Elli] 
i=1 


Now, 


E|I,] = P{“1” in position 1} 


3 
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andforl <isn+i+m, 


Efi] = P{“0” in position i — 1, “1” in position i} 
m n 


~ntmn+tm—1 


Hence, P ae 
E[RQ)] = +m—1 
cee) n+m oe aan le pit 1 
Similarly, E[R(0)], the expected number of runs of 0’s, is 
E[RO)] = —— + — 
“natm ‘on +m 
and the expected number of runs of either type is 
2nm 
E[RG) + RO)]=1 + | 
n+m 


EXAMPLE 21 A random walk in the plane 


Consider a particle initially located at a given point in the plane, and suppose that it 
undergoes a sequence of steps of fixed length, but in a completely random direction. 
Specifically, suppose that the new position after each step is one unit of distance from 
the previous position and at an angle of orientation from the previous position that is 
uniformly distributed over (0, 27). (See Figure 7.1.) Compute the expected square of 
the distance from the origin after n steps. 


) = initial position 
O) = position after first step 
@) = position after second step 


FIGURE 7.1 


Solution. Letting (Xj, Y;) denote the change in position at the ith step, i = 1,...,n, 
in rectangular coordinates, we have 

Xj = COs 6; 

Y; = sin6; 
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where 6;,i = 1,...,, are, by assumption, independent uniform (0, 27) random vari- 


Y; |, 


n 
ables. Because the position after n steps has rectangular coordinates | > Xi, 
= 1 


i=l i 
it follows that D7, the square of the distance from the origin, is given by 


n 


2 2 
n n 
P=|> 4) + [> ¥ 
i=1 i=1 
n 
=a? + ¥) + Wax + VN) 
i=l iZj 
=n+ ? Y “(cos 6; cos 6; + sin 6; sin 6;) 
iZj 


where cos? 6; + sin? 6; = 1. Taking expectations and using the independence of 6; and 
6; when i # j and the fact that 


20 
2x E[cos 6;] = / cosudu = sin2x — sin0=0 
0 
20 
2x E[sin 6;] = / sinu du = cos0 — cos27 = 0 
0 
we arrive at 
E[D?] =n a 


EXAMPLE 2m Analyzing the quick-sort algorithm 


Suppose that we are presented with a set of n distinct values x;,x2,...,xX, and that 
we desire to put them in increasing order, or as it is commonly stated, to sort them. 
An efficient procedure for accomplishing this task is the quick-sort algorithm, which 
is defined as follows. When n = 2, the algorithm compares the two values and then 
puts them in the appropriate order. When n > 2, one of the elements is randomly 
chosen—say it is x;—and then all of the other values are compared with x;. Those 
smaller than x; are put in a bracket to the left of x; and those larger than x; are put 
in a bracket to the right of x;. The algorithm then repeats itself on these brackets and 
continues until all values have been sorted. For instance, suppose that we desire to 
sort the following 10 distinct values: 


5,9, 3, 10, 11, 14, 8,4, 17,6 


We start by choosing one of them at random (that is, each value has probability - of 
being chosen). Suppose, for instance, that the value 10 is chosen. We then compare 
each of the others to this value, putting in a bracket to the left of 10 all those values 
smaller than 10 and to the right all those larger. This gives 


{5, 9,3, 8,4, 6}, 10, {11, 14, 17} 


We now focus on a bracketed set that contains more than a single value—say the one 
on the left of the preceding—and randomly choose one of its values—say that 6 is 
chosen. Comparing each of the values in the bracket with 6 and putting the smaller 
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ones in a new bracket to the left of 6 and the larger ones in a bracket to the right 
of 6 gives 
{5, 3, 4}, 6, (9, 8}, 10, (11, 14, 17} 


If we now consider the leftmost bracket, and randomly choose the value 4 for com- 
parison then the next iteration yields 


{3}, 4, {5}, 6, {9, 8}, 10, {11, 14, 17} 


This continues until there is no bracketed set that contains more than a single value. 

If we let X denote the number of comparisons that it takes the quick-sort algorithm 
to sort n distinct numbers, then ELX] is a measure of the effectiveness of this algo- 
rithm. To compute ELX], we will first express X as a sum of other random variables 
as follows. To begin, give the following names to the values that are to be sorted: 
Let 1 stand for the smallest, let 2 stand for the next smallest, and so on. Then, for 
1 =i <j <n, let J(i,j) equal 1 if i and j are ever directly compared, and let it equal 
0 otherwise. With this definition, it follows that 


n-1 n 
X=) VO IGA 


i=1 j=it+1 


implying that 


n—-l1 on 
a S > P{i and j are ever compared} 
i=1 j=i+1 


To determine the probability that 7 and j are ever compared, note that the values 
ii + 1,...,j7 — 1,7 will initially be in the same bracket (since all values are initially 
in the same bracket) and will remain in the same bracket if the number chosen for 
the first comparison is not between i and j. For instance, if the comparison number is 
larger than j, then all the values i,i + 1,...,j — 1,j will go in a bracket to the left of 
the comparison number, and if it is smaller than 7, then they will all go in a bracket 
to the right. Thus all the values 7,i + 1,...,7 — 1,j will remain in the same bracket 
until the first time that one of them is chosen as a comparison value. At that point all 
the other values between i and j will be compared with this comparison value. Now, 
if this comparison value is neither i nor j, then upon comparison with it, 7 will go into 
a left bracket and j into a right bracket, and thus i and j will be in different brackets 
and so will never be compared. On the other hand, if the comparison value of the set 
ii + 1,...,j — 1,/ is either 7 or j, then there will be a direct comparison between 
i and j. Now, given that the comparison value is one of the values between i and j, 
it follows that it is equally likely to be any of these j — i + 1 values, and thus the 
probability that it is either i or j is 2/(j — i + 1). Therefore, we can conclude that 


2 
P{i and j are ever compared} = (Tat 
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and 
n—-1 n 2 
E|X] = ——____ 
MI= 22 Fiat 
i=1 j=i+1 


To obtain a rough approximation of the magnitude of ELX] when vn is large, we can 
approximate the sums by integrals. Now 


= 2 [ 2 
> a = Se ~ ——__— dx 
a rE wix—-itl 
. n 
= 2log(x — i+ VY ay 
= 2log(n — i + 1) — 2log(2) 
~ 2log(iv — i + 1) 


Thus 
n—-1 
E[X] ® 5° 2login — i + 1) 
i=1 


n—-1 
~2 | log(n — x + 1)dx 
1 


=2 | togyrdy 


= 2(ylog(y) — y)I5 
= 2n log(n) 


Thus we see that when n is large, the quick-sort algorithm requires, on average, 
approximately 2n log(m) comparisons to sort n distinct values. | 


EXAMPLE 2n The probability of a union of events 


Let Aj,... A, denote events, and define the indicator variables Xj,i = 1,...,n, by 


ye 1 if A; occurs 
'“~)0 otherwise 
Now, note that 
n 
_ jl if U A; occurs 
i ite le {0 otherwise 
(= 


Hence, 


E|1- Ta — Xi)| =P Ua) 


i=1 
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Expanding the left side of the preceding formula yields 


n n 
P{JAi) =£] 0% -— 00% X + DY XX: 
i=1 i=1 


i<j i<j<k 
sens Go (1 sae, (2.3) 
However, 
1 if Aj, Aj, --- Aj, occurs 
Xi, Xin Xi = : 
QO otherwise 
so 


E[X;, «+: Xi,] = P(Ai, - + Aix) 


Thus, Equation (2.3) is just a statement of the well-known formula for the union of 


events: 
P(UA)) =D) P(A) — DY DPA) + DOD DP iA;An) 


i<j i<j<k 
= nen CP PA eA | 


When one is dealing with an infinite collection of random variables X;,i = 1, each 
having a finite expectation, it is not necessarily true that 


E WX; = AIX (2.4) 
i=1 


i=1 


Co n 
To determine when (2.4) is valid, we note that }> X; = lim >> Xj. Thus, 
i=1 NP OO jay 


[oe] n 
E|\ SX l=E jim Xi 
i=1 i=1 
n 
=| 
i=1 
n 
= Jim E|Xj] 
i=1 
[oe] 
=) Ex] (2.5) 


Hence, Equation (2.4) is valid whenever we are justified in interchanging the expec- 
tation and limit operations in Equation (2.5). Although, in general, this interchange 
is not justified, it can be shown to be valid in two important special cases: 


1. The Xj are all nonnegative random variables. (That is, PLX; = 0} = 1 for all 7.) 


2, > El |XGl| = ee: 
i=1 
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EXAMPLE 20 
Consider any nonnegative, integer-valued random variable X. If, for each i = 1, we 
define 

co {0 ifX =i 


0 ifX <i 
then 
fore) x ee) 
> *% = x aot 2 Xj 
i=1 i=1 i=X+1 
x fore) 
=)-1+ do 0 
i=1 i=X+1 
=X. 


Hence, since the Xj are all nonnegative, we obtain 


E[X] = )0 E(X) 
i=1 


co 
= So PIX > i} (2.6) 
i=1 
a useful identity. | 
EXAMPLE 2p 
Suppose that n elements—call them 1, 2, ..., n—must be stored in a computer in the 


form of an ordered list. Each unit of time, a request will be made for one of these 
elements—i being requested, independently of the past, with probability P@, i = 1, 
>> P@ = 1. Assuming that these probabilities are known, what ordering minimizes 


L 
the average position in the line of the element requested? 


Solution. Suppose that the elements are numbered so that P(1) = P(2) =--- = P(n). 
To show that 1, 2, ..., 1 is the optimal ordering, let X denote the position of the 
requested element. Now, under any ordering—say, O = ij, i0,...,in, 


PolX = k= >> Pi) 
jak 


=) PH 
j=k 
= Pi2,... .n{X = k} 


py nvey 


Summing over k and using Equation (2.6) yields 


thus showing that ordering the elements in decreasing order of the probability that 
they are requested minimizes the expected position of the element requested. Oo 
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*7.2.1. Obtaining Bounds from Expectations via the Probabilistic Method 


The probabilistic method is a technique for analyzing the properties of the elements 
of a set by introducing probabilities on the set and then studying an element chosen 
according to those probabilities. The technique was previously seen in Example 41 of 
Chapter 3, where it was used to show that a set contained an element that satisfied a 
certain property. In this subsection, we show how it can sometimes be used to bound 
complicated functions. 
Let f be a function on the elements of a finite set S, and suppose that we are 

interested in 

m cares (s) 
A useful lower bound for m can often be obtained by letting S be a random element 
of S for which the expected value of f(S) is computable and then noting that m = f(S) 
implies that 

m = Elf(S)] 


with strict inequality if f(S) is not a constant random variable. That is, E[f(S)] is a 
lower bound on the maximum value. 


EXAMPLE 2q The maximum number of Hamiltonian paths in a tournament 
A round-robin tournament of n > 2 contestants is a tournament in which each of the 


; pair of contestants play each other exactly once. Suppose that the players are 
numbered 1,2,3,...,. The permutation ij, i2,...i, is said to be a Hamiltonian path if 
i, beats iz, iz beats 13,..., and i,_; beats i,. A problem of some interest is to determine 
the largest possible number of Hamiltonian paths. 

As an illustration, suppose that there are 3 players. On the one hand, one of them 
wins twice, then there is a single Hamiltonian path. (For instance, if 1 wins twice and 
2 beats 3, then the only Hamiltonian path is 1, 2, 3.) On the other hand, if each of 
the players wins once, than there are 3 Hamiltonian paths. (For instance, if 1 beats 2, 
2 beats 3, and 3 beats 1, then 1, 2, 3; 2, 3, 1; and 3, 1, 2, are all Hamiltonians). Hence, 
when n = 3, there is a maximum of 3 Hamiltonian paths. 

We now show that there is an outcome of the tournament that results in more than 
n!/2"-! Hamiltonian paths. To begin, let the outcome of the tournament specify the 


n 
result of each of the “ games played, and let S denote the set of all 2 7. possible 


tournament outcomes. Then, with f(s) defined as the number of Hamiltonian paths 
that result when the outcome is s € S, we are asked to show that 


n! 
Qn-1 


To show this, consider the randomly chosen outcome S that is obtained when the 


max fs = 


results of the 5 games are independent, with each contestant being equally likely 


to win each encounter. To determine E[f(S)], the expected number of Hamiltonian 
paths that result from the outcome S, number the n! permutations, and, for i = 
1,...,n!, let 
1, if permutation 7 is a Hamiltonian 
Xj = : 
0, otherwise 
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Since 


f(S) = DXi 


it follows that 


E[f(S)] = 0 EX] 


Because, by the assumed independence of the outcomes of the games, the probability 
that any specified permutation is a Hamiltonian is (1/2)"~', it follows that 


AAS Pega) = yoy 


Therefore, 
E[f(S)] = nid /2)"* 


Since f(S) is not a constant random variable, the preceding equation implies that 
there is an outcome of the tournament having more than n!/2”~! Hamiltonian 
paths. | 


EXAMPLE 2r 


A grove of 52 trees is arranged in a circular fashion. If 15 chipmunks live in these 
trees, show that there is a group of 7 consecutive trees that together house at least 3 
chipmunks. 


Solution. Let the neighborhood of a tree consist of that tree along with the next six 
trees visited by moving in the clockwise direction. We want to show that, for any 
choice of living accommodations of the 15 chipmunks, there is a tree that has at least 
3 chipmunks living in its neighborhood. To show this, choose a tree at random and 
let X denote the number of chipmunks that live in its neighborhood. To determine 
E|X], arbitrarily number the 15 chipmunks and for i = 1,..., 15, let 


X= 1, if chipmunk / lives in the neighborhood of the randomly chosen tree 
‘10, otherwise 


Because i 
X=) Xj 
i=1 
we obtain that 


15 
E[X] = >> F(X 
i=] 


However, because X; will equal 1 if the randomly chosen tree is any of the 7 trees 
consisting of the tree in which chipmunk i lives along with its 6 neighboring trees 
when moving in the counterclockwise direction, 


7 
E[Xi] = PiXi= Y= 


Consequently, 
105 


~ 52. 


showing that there exists a tree with more than 2 chipmunks living in its neigh- 
borhood. 


E[X] >2 
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*7.2.2. The Maximum-Minimums Identity 


We start with an identity relating the maximum of a set of numbers to the minimums 
of the subsets of these numbers. 


Proposition 2.2. For arbitrary numbers x;,i = 1,...,n, 
max xj = ba — >. min(x;,xj) + » min(Xj, Xj,Xk) 
’ i i<j i<j<k 


tap. a (a0 nn, cs ad 


Proof. We will give a probabilistic proof of the proposition. To begin, assume that 
all the x; are in the interval [0, 1]. Let U be a uniform (0, 1) random variable, and 
define the events Aj,i = 1,...,n, by Aj = {U < x;}. That is, A; is the event that 
the uniform random variable is less than x;. Because at least one of these events A; 
will occur if U is less than at least one of the values x;, we have that 


U;A;j = {u < max] 
L 


Therefore, 
P(U;A;) = P | U< maxs| = maxx; 
L t 


Also, 
PAJ=P(U = a)ax 


In addition, because all of the events A;,,...,Aj;, will occur if U is less than all the 
values x;,,...,Xi,, we see that the intersection of these events is 


Aj 


j=l? 


peoeeE = {e < min «| 


implying that 


PiAgs.AL)= pfu < ain «| = on Xi, 
Jalyeaur jal 


Thus, the proposition follows from the inclusion—exclusion formula for the proba- 
bility of the union of events: 


PU;Ai) =) P(A) — DPA) + SY) PCAA;AR) 
i i<j i<j<k 


+ de (TPA. acAa) 


When the x; are nonnegative, but not restricted to the unit interval, let c be such 
that all the x; are less than c. Then the identity holds for the values y; = x;/c, and 
the desired result follows by multiplying through by c. When the x; can be negative, 
let b be such that x; + b > 0 for alli. Therefore, by the preceding, 


max(xj + b) =) (xi + b) — D> min; + b,x) + b) 
L ; ar 
1 I<] 


fe eee (1) ming + By...5%% 4 BD 
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Letting 


M=)ox - Y= min(ai,x/) se eee (1)! min Gy, cag Xp) 


i<j 


we can rewrite the foregoing identity as 


mana + b= M4 (1 — i) jie oe com(")) 
n_ n n{n 
0=(d —- 1) =t-n+(S)+ 40 (") 


The preceding two equations show that 


But 


maxx; = M 
L 


and the proposition is proven. 


It follows from Proposition 2.2 that, for any random variables X1,...,Xn, 
X= )°X - aX AE eee se 1 mC a 
as i dX i dX min(Xj, D) of + {=1) min( 1> Xn) 


Taking expectations of both sides of this equality yields the following relationship 
between the expected value of the maximum and those of the partial minimums: 


| max.x] = XA = S > E[min(X;, X))] 


i<j 


eases tsi lide... dea (2.7) 


EXAMPLE 2s Coupon collecting with unequal probabilities 


Suppose there are n different types of coupons and that each time one collects a 
coupon, it is, independently of previous coupons collected, a type i coupon with prob- 
n 


ability pj, >> pj = 1. Find the expected number of coupons one needs to collect to 
i=1 
obtain a complete set of at least one of each type. 


Solution. If we let X; denote the number of coupons one needs collect to obtain a 
type i, then we can express X as 


Because each new coupon obtained is a type i with probability p;, X; is a geometric 
random variable with parameter p;. Also, because the minimum of X; and_X; is the 
number of coupons needed to obtain either a type i or a type j, it follows that, for 
i # j, min (Xj, Xj) is a geometric random variable with parameter p; + pj. Similarly, 
min (X;,.X;,X;,), the number needed to obtain any of types i, j, and k, is a geometric 
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random variable with parameter p; + pj + px, and so on. Therefore, the identity (2.7) 


yields 
1 1 1 
axj=y+- yt 
; Pi ij Di + Dj ik Pi + Pj + Pk 
Fees + (-1)"" : 
Plo se 
Noting that 


and using the identity 
n 
= [[a — PM) yer - yer ge A Ey ie 
i=l i i<j 


shows, upon integrating the identity, that 


E[X] = / “t1- [ [a - e?*) | ax 
0 i=1 


is amore useful computational form. | 


7.3, MOMENTS OF THE NUMBER OF EVENTS THAT OCCUR 


Many of the examples solved in the previous section were of the following form: For 
given events Aj,...,An, find E[X], where X is the number of these events that occur. 
The solution then involved defining an indicator variable J; for event A; such that 


Le 1, if. A; occurs 
‘~~ )0, otherwise 


Because 
n 
ae at! 
i=1 


we obtained the result 
n n n 
AA=2)|> h)\2> fil= > Pad (3.1) 
i=1 i=1 i=1 


Now suppose we are interested in the number of pairs of events that occur. 
Because J;J; will equal 1 if both A; and A; occur, and will equal 0 otherwise, it fol- 
lows that the number of pairs is equal to }°; <j lilj. But because X is the number of 


events that occur, it also follows that the number of pairs of events that occur is Ch. 


Consequently, 
xX 
(;) = Ll 


i<j 
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where there are C) terms in the summation. Taking expectations yields 


E iG ) = Yo Eth) = PAA) (3.2 


i<j i<j 
= X(X — 1) 
E a = om P(A;A)j) 
i<j 
giving that 
E[X?] — E[X]=2)° P(AjAj) (3.3) 
i<j 


which yields E[LX?], and thus Var(X) = E[X?] — (E[X]). 
Moreover, by considering the number of distinct subsets of k events that all occur, 


we see that x 
(“) = > ln Tig 
1 <12<...<i 
Taking expectations gives the identity 


|()|- YS Fila l= D> PAgAn--- Aa) (3.4) 


1 <i7 <...<ig 1 <i7<...<ix 


EXAMPLE 3a Moments of binomial random variables 


Consider n independent trials, with each trial being a success with probability p. Let 
Aj; be the event that trial i is a success. When i # j, P(AjAj) = p*. Consequently, 


Equation (3.2) yields 
X\ | _ 2.7 \2 
e((2)| “LP's (;)e 
or 
E[X(X — 1)]=n(n — 1p? 
or 


E[X?] — E[X]=n(n — 1)p? 
Now, E[X] = }“_, P(Aj) = np, so, from the preceding equation 


Var(X) = E[X?] — (E[X])? =n(n — 1p? + np — (np)? = np — p) 


which is in agreement with the result obtained in Section 4.6.1. 
In general, because P(Aj, Aj, ---Ai,) = pk , we obtain from Equation (3.4) that 


x n 
E > k k 
( k ) Gs i () 
ly <In<...<ig 
or, equivalently, 


EX = eet(X =k + Dl Hn@— D-H = K+ Dp* 
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The successive values E[X*], k = 3, can be recursively obtained from this identity. 
For instance, with k = 3, it yields 


E[X(X — 1)(X — 2)] =n — In — 2)p? 


or 


Exe a A a: 2X] =n(n — 1)(n — 2)p? 


or 


E[X?] = 3E[X?] — 2E[X] + n(n — 1) — 2)p° 
=3n(n — Dp? + np + nn — Dn — 2)p° | 


EXAMPLE 3b Moments of hypergeometric random variables 


Suppose v balls are randomly selected from an urn containing N balls, of which m 
are white. Let A; be the event that the ith ball selected is white. Then X, the number 
of white balls selected, is equal to the number of the events A;,...,A, that occur. 
Because the ith ball selected is equally likely to be any of the N balls, of which m are 
white, P(A;) = m/N. Consequently, Equation (3.1) gives that ELX] = )*_, P(Aj) = 
nm/N. Also, since 


mm—1 
P(AjAj) = P(Aj)P(Aj|Ai) = NN od 


we obtain, from Equation (3.2), that 


xX _ mm —1)_ (n\mm — I) 
l(2)) = Ln@w— = oak -1) 


i<j 


or 
_ mim — 1) 
E[X(X — 1I)]=ntn — NW) 
showing that 
2 mim — 1) 
E[|X*] =n(n Nw > 7 E[X] 


This formula yields the variance of the hypergeometric, namely, 


Var(X) = E[X*] — (E[X])* 
m(m — 1) nm n2m2 
=n(n NW —D N N2 
_mn E — 1)(m — 1) 4 | 
N N-1 N 


which agrees with the result obtained in Example 8j of Chapter 4. 
Higher moments of X are obtained by using Equation (3.4). Because 

mim — 1)---(m — k + 1) 

N(N — 1)---(N — k + 1) 


P(Aj, Ai, ++ Aig) = 
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Equation (3.4) yields 
E (7) = (ea eee 
k}| \k/ NWN - 1)---(N —k 4+ 1) 


EINK = D(X = kA] 


or 


7 | m(m — 1)---(m — k + 1) 
=n(n — 1)---(n k 4 DV oD oN CRED 7 


EXAMPLE 3c Moments in the match problem 


For i = 1,...,N, let A; be the event that person i selects his or her own hat in the 
match problem. Then 

1 1 

NN-1 

which follows because, conditional on person i selecting her own hat, the hat selected 
by person j is equally likely to be any of the other N — 1 hats, of which one is his 


own. Consequently, with X equal to the number of people who select their own hat, 
it follows from Equation (3.2) that 


[(@)|-2aata= (aw 


i<j 


P(AjA)j) _ P(Aj)P(Aj|Ai) = 


thus showing that 
E[X(X — 1] =1 


Therefore, E[X*] = 1 + E[X]. Because ELX] = ~S P(A;) = 1, we obtain that 
Var(X) = ELX?] — (E[X])* =1. 


Hence, both the mean and variance of the number of matches is 1. For higher moments, 
we use Equation (3.4), along with the fact that P(Aj, Aj, ---Ai,) = NWS NERS? 


to obtain 
el (*X\i_(% 1 
(7) =) swoop 


EUX(X = t)(® —k $4) =1 | 


or 


EXAMPLE 3d Another coupon-collecting problem 


Suppose that there are N distinct types of coupons and that, independently of past 
types collected, each new one obtained is type j with probability p;, =- 1 Pj = 1. Find 
the expected value and variance of the number of different types of coupons that 
appear among the first 1 collected. 


Solution. We will find it more convenient to work with the number of uncollected 
types. So, let Y equal the number of different types of coupons collected, and let 
X = WN — Y denote the number of uncollected types. With A; defined as the event 
that there are no type 7 coupons in the collection, X is equal to the number of the 
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events A,,...,Ay that occur. Because the types of the successive coupons collected 
are independent, and, with probability 1 — p; each new coupon is not type i, we have 


P(Aj) = (1 — pi)" 


Hence, E[X] = yd — pi)", from which it follows that 
N 
E[Y]=N — E[X]=N - S70 — py" 
i=1 


Similarly, because each of the n coupons collected is neither a type i nor a type j 
coupon, with probability 1 — p; — p;, we have 
PAA) =.= pp = py's Fi 


Thus, 
E[X(X - 1)]=2)0 P(4,A) =2500 — pi — pp” 
i<j i<j 
or 
E[X7]=25° — pi — pp)” + E[X] 


i<j 
Hence, we obtain 
Var(Y) = Var(X) 
= E[X?] — (E[X])? 


N N 
=2)¢d - pi — pj)" + D0 - pa" - [0d - pa” 
1 i=1 


i<j i= 


2 


In the special case where pj; = 1/N,i=1,...,N, the preceding formula gives 


anew[r— (1 2)] 


var(y) = Nw = 1)(1 =) +N(1 =) m3) a 
= N) | N N 


EXAMPLE 3e¢e The negative hypergeometric random variables 


and 


Suppose an urn contains n + m balls, of which n are special and m are ordinary. These 
items are removed one at a time, with each new removal being equally likely to be 
any of the balls that remain in the urn. The random variable Y, equal to the number 
of balls that need be withdrawn until a total of r special balls have been removed, 
is said to have a negative hypergeometric distribution. The negative hypergeometric 
distribution bears the same relationship to the hypergeometric distribution as the 
negative binomial does to the binomial. That is, in both cases, rather than considering 
a random variable equal to the number of successes in a fixed number of trials (as are 
the binomial and hypergeometric variables), they refer to the number of trials needed 
to obtain a fixed number of successes. 
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To obtain the probability mass function of a negative hypergeometric random vari- 
able X, note that _X will equal k if both 
(a) the first k — 1 withdrawals consist of r — 1 special and k — r ordinary balls and 
(b) the Ath ball withdrawn is special. 


Consequently, 


ears | Faae| Mae a ae | 


Cy) n+tm—-k+1 


P{X =khy= 


We will not, however, utilize the preceding probability mass function to obtain the 


mean and variance of Y. Rather, let us number the m ordinary balls as 01,...,0m, 
and then, for each i = 1,...,n, let A; be the event that 0; is withdrawn before r 
special balls have been removed. Then, if X is the number of the events A1,...,Am 


that occur, it follows that X is the number of ordinary balls that are withdrawn before 
a total of r special balls have been removed. Consequently, 


Y=r+X 
showing that 


E[Y]=r + E[X]=r+ >> PAD 
i=1 


To determine P(Aj;), consider the n + 1 balls consisting of 0; along with the n special 

balls. Of these n + 1 balls, 0; is equally likely to be the first one withdrawn, or the 

second one withdrawn, ..., or the final one withdrawn. Hence, the probability that 

it is among the first r of these to be selected (and so is removed before a total or r 
r 


special balls have been withdrawn) is =7;. Consequently, 


r 


POG = a4 


and ( b 
r rn+tmt 
ElyYy|= | = 
Cass ares | n+1 


Thus, for instance, the expected number of cards of a well-shuffled deck that would 
need to be turned over until a spade appears is 1 + a = 3.786, and the expected 
number of cards that would need to be turned over until an ace appears is 
14+ $=106. 

To determine Var(Y) = Var(X), we use the identity 


E[X(X — 1)]=2)° P(AiAj) 


i<j 


Now, P(A;A)j) is the probability that both 0; and o; are removed before there have 
been a total of r special balls removed. So consider the n + 2 balls consisting of 0;, 0;, 
and the n special balls. Because all withdrawal orderings of these balls are equally 
likely, the probability that 0; and o; are both among the first r + 1 of them to be 
removed (and so are both removed before r special balls have been withdrawn) is 


(JO) re + 0) 


(?) ~~ @t D@ + 2) 


P(A;Aj) = 
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Consequently, et 
m r(r 
ee v)=2(3)z + Din + 2) 
so 
21 r+ 1) 
E[|X*] =m(m — 1) moe Dat D E[X] 
Because E[X’] = m--,, this yields 
_ = rr + 1) r r 
Var(Y) = Var(X) = m(m — 1) a Dee Ee 4 (m- = 7) 


A little algebra now shows that 


mr(n + 1 r)(n +m +4 1) 
(n + 1)?(n + 2) 
EXAMPLE 3f Singletons in the coupon collector’s problem 


Var(Y) = 


Suppose that there are n distinct types of coupons and that, independently of past 
types collected, each new one obtained is equally likely to be any of the n types. 
Suppose also that one continues to collect coupons until a complete set of at least 
one of each type has been obtained. Find the expected value and variance of the 
number of types for which exactly one coupon of that type is collected. 


Solution. Let X equal the number of types for which exactly one of that type is col- 
lected. Also, let T; denote the ith type of coupon to be collected, and let A; be the 
event that there is only a single type 7; coupon in the complete set. Because X is 
equal to the number of the events Aj,..., A, that occur, we have 


E[X] =) P(A) 
i=1 


Now, at the moment when the first type 7; coupon is collected, there remain n — i 
types that need to be collected to have a complete set. Because, starting at this moment, 
each of these n — i + 1 types (the n — i not yet collected and type 7;) is equally 
likely to be the last of these types to be collected, it follows that the type 7; will be the 
last of these types (and so will be a singleton) with probability ——. Consequently, 


n—i+1* 
P(Aj) = —. yielding 


n 
1 1 
E|X] = = 
[*] os n-i+l 2 i 
i=1 i=1 
To determine the variance of the number of singletons, let S; ;, fori < j, be the event 
that the first type 7; coupon to be collected is still the only one of its type to have 


been collected at the moment that the first type 7; coupon has been collected. Then 
P(AjAj) = P(AjAj|Sij)POSi;) 


Now, P(Sj;) is the probability that when a type 7; has just been collected, of the 
n — i + 1 types consisting of type 7; and the n — ias yet uncollected types, a type T; 
is not among the first ; — i of these types to be collected. Because type Tj is equally 
likely to be the first, or second, or ...,7 — i+ 1 of these types to be collected, we have 


j-i bt legj 
A=f+1 ato =F 


P(Sij) =1 
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Now, conditional on the event $;;, both A; and A; will occur if, at the time the first 
type 7; coupon is collected, of the n — j + 2 types consisting of types 7;, 7;, and the 
n — jas yet uncollected types, 7; and 7; are both collected after the other n — j. But 
this implies that 


1 1 
P(A;A,\|S;;) = 2 
(AjAj|Sij) “i jt2n ei 
Therefore, 
2 
P(AjAj) = 
i eae ea 
yielding 


1 
1-)m+2—-)) 


E[X(X - )]=4)>° a 
i<j 


Consequently, using the previous result for ELX], we obtain 


2 
1 | oe 
Var(X) = 4) 7 bh =i? =p | dj =) " 


i<j 


7.4 COVARIANCE, VARIANCE OF SUMS, AND CORRELATIONS 


The following proposition shows that the expectation of a product of independent 
random variables is equal to the product of their expectations. 


Proposition 4.1. If X and Y are independent, then, for any functions / and g, 
Elg(X)A(Y)] = Elg(XOJE[AY)] 
Proof. Suppose that X and Y are jointly continuous with joint density f(x, y). Then 
CO (oe) 
Elgon] = ff gcanorses.y)dedy 

—oo J —00 

CO (oe) 

=| [_ scononfecofven deay 

—CO ¥J —O0O 


=| horfrordy f geofecs ax 
= FIM) IElg(X)] 


The proof in the discrete case is similar. 


Just as the expected value and the variance of a single random variable give us 
information about that random variable, so does the covariance between two random 
variables give us information about the relationship between the random variables. 


Definition 


The covariance between X and Y, denoted by Cov (X, Y), is defined by 
Cov(X, Y) = E[(X — E[X)(Y — E[Y)] 
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Upon expanding the right side of the preceding definition, we see that 


Cov(X, Y) = E[XY — E[X]Y — XE[Y] + E[YJE[X]] 
= E[XY] — E[X]E[Y] -— E[X]E[Y] + ELX]JE[Y] 
= E[XY] — E[X]E[Y] 
Note that if X and Y are independent, then, by Proposition 4.1, Cov(x, Y) = 0. 
However, the converse is not true. A simple example of two dependent random vari- 


ables X and Y having zero covariance is obtained by letting XY be a random variable 
such that { 


PIX =0} = P(X = 1} = PX =-l= 5 


and defining 
0 ifX #0 
se {) ifX =0 


Now, XY = 0, so E[XY] = 0. Also, ELX] = 0. Thus, 
Cov(X, Y) = E[XY] -— E[X]E[Y] =0 
However, X and Y are clearly not independent. 
The following proposition lists some of the properties of covariance. 
Proposition 4.2. 
(i) Cov(X, Y) = Cow(Y, X) 


(ii) Cov(X, X) = Var(X) 
(iii) Cov(aX, Y) = a Cov(X, Y) 


n 


(iv) Cov » % » yi= > > Cov(Xi, Yj) 
i=1 j=1 


i=1 j=1 


Proof of Proposition 4.2: Parts (i) and (ii) follow immediately from the definition 
of covariance, and part (ili) is left as an exercise for the reader. To prove part (iv), 
which states that the covariance operation is additive (as is the operation of taking 
expectations), let 4; = ELX;] and v; = E[Y;]. Then 


and 


Cov dx DEY) =F (Ex - En) Daa 


=E| DX — wi) 0% — vy) 
i=1 j=l 
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n 


Da (Xi — wi)(¥j - vp] 


i=1 j 


where the last equality follows because the expected value of a sum of random vari- 
ables is equal to the sum of the expected values. 


It follows from parts (ii) and (iv) of Proposition 4.2, upon taking Y; = Xj,j = 
1,...,n, that 


Var WX = Cov 3x, X; 
i=1 i=l j=l 
= aes Cov(X;, Xj) 
i=1 j=1 
= = Lovers) + > > Cov(Xj, Xj) 


Ay 


Since each pair of indices i, j,i # j, appears twice in the double summation, the pre- 
ceding formula is equivalent to 


WX = Lover) + 29° >> Cov(Xi,X)) (4.1) 


i<j 


If X1,..., Xn are pairwise independent, in that X; and Xj are independent for i # j, 
then Equation (4.1) reduces to 


> Xj = 3 Var(X;) 
i=l 


i=l 
The following examples illustrate the use of Equation (4.1). 


EXAMPLE 4a 
Let X1,...,X, be independent and identically distributed random variables having 
_ n 
expected value ju and variance o”, and as in Example 2c, let ¥ = )~ Xj/n be the sam- 
i=1 
ple mean. The quantities X; — X,i=1,...,n, are called deviations, as they equal the 
differences between the individual data and the sample mean. The random variable 


n  P2 
ea Ha® 


< n—1 
i=1 


is called the sample variance. Find (a) Var(X) and (b) E[S7]. 
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Solution. 


(a) Var(X) = 


II 
a nn a 


i=1 


(b) We start with the following algebraic identity: 


(n — 1)S? = Di w+ XY 


= x — wy + DO - wp? - 2k - w) OK - w) 


i=1 


= DUK — ow)? + 0 — wy — 2K — wn — w) 


n 
= 0% - wy -— n(X - py? 
Taking expectations of the preceding yields 


(n — 1E[S*] = =a, — wy] — nE[&® — 4)" 
i=1 


=no” — nVar(X) 

=(n — 1)o? 
where the final equality made use of part (a) of this example and the one preceding 
it made use of the result of Example 2c, namely, that E[X] = ju. Dividing through 


by n — 1 shows that the expected value of the sample variance is the distribution 
variance o?. O 


Our next example presents another method for obtaining the variance of a bino- 
mial random variable. 
EXAMPLE 4b Variance of a binomial random variable 


Compute the variance of a binomial random variable X with parameters n and p. 
Solution. Since such a random variable represents the number of successes in n inde- 
pendent trials when each trial has the common probability p of being a success, we 


may write 
X=X, +--+ Xn 


where the X; are independent Bernoulli random variables such that 


Y= 1 if the /th trial is a success 
‘1/0 otherwise 
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Hence, from Equation (4.1), we obtain 


Var(X) = Var(X;) + --» + Var(Xn) 


But 
Var(X;) = ELX?] — (E[Xi])” 
= E[X;] — (E[X;])? since xe = X; 
=p-p 
Thus, 
Var(X) = np(1 — p) a 


EXAMPLE 4c Sampling from a finite population 


Consider a set of N people, each of whom has an opinion about a certain subject that 
is measured by a real number v that represents the person’s “strength of 
feeling” about the subject. Let v; represent the strength of feeling of person i, 
i=1,...N. 

Suppose that the quantities v;,i = 1,...,N, are unknown and, to gather informa- 
tion, a group of n of the N people is “randomly chosen” in the sense that all of the 


subsets of size n are equally likely to be chosen. These n people are then ques- 


tioned and their feelings determined. If S denotes the sum of the n sampled values, 
determine its mean and variance. 

An important application of the preceding problem is to a forthcoming election 
in which each person in the population is either for or against a certain candidate or 
proposition. If we take v; to equal 1 if person i is in favor and 0 if he or she is against, 

N 


then ¥ = )°v;/N represents the proportion of the population that is in favor. To 
i=1 

estimate V, a random sample of 1 people is chosen, and these people are polled. The 

proportion of those polled who are in favor—that is, $/n—is often used as an estimate 

of V. 


Solution. For each person i,i = 1,...,N, define an indicator variable J; to indicate 
whether or not that person is included in the sample. That is, 


ae 1 if person iis in the random sample 
‘“~]0 otherwise 


Now, S can be expressed by 


SO 
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Var(S) = Svat Ti) + Sp = Cov(vili, vjJ;) 


i<j 


= = Sivan + 25°) > vivjCov(hi, Fj) 


i<j 
Because 
n 
nn—1 
E{i,J;)= — 
itil NN-1 


it follows that 


= NW 1) N 
—n(N — n) 
N2(N — 1) 
Hence, 
N 
E[S] =n > _ = nv 


Var(S) = x (= 


= 2n(N 
") 2 ean 2dr 


i<j 
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The expression for va) can be simplified somewhat by using the identity 


(vy bee + y= > ve +2») Divivj- After some simplification, we obtain 


i=1 i<j 
N 
(N ) a 
n ed i=1 ay} 
Var(S) = . 
=e 


Consider now the special case in which Np of the v’s are equal to 1 and the remain- 
der equal to 0. Then, in this case, S is a hypergeometric random variable and has 


mean and variance given, respectively, by 


and 


Var(S) = i =e) (+ r*) 
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The quantity S/n, equal to the proportion of those sampled which have values equal 
to 1, is such that 


S N—-—n 
Var (>) = n= pra D) a 


The correlation of two random variables X and Y, denoted by p(X, Y), is defined, 
as long as Var(X) Var(Y) is positive, by 


Cov(Xx, Y) 
(X,Y) = 
J Var(X)Var(Y) 
It can be shown that 
—-1s p(X,Y) <1 (4.2) 


To prove Equation (4.2), suppose that X and Y have variances given by o? and o?, 
respectively. Then, on the one hand, 


XxX Y 
0 < Var (z + | 
Ox Oy 


_ Var(X) Var(Y) 2Cov(X, Y) 
rn 
= 2[1 + p(X, Y)] 


Ox0y 


implying that 
—1 = p(X,Y) 
On the other hand, 
0 = Var (z — x) 
Ox Oy 
_ Var(X) VarY 2Cov(xX, Y) 
- ay | (—oy)? OxOy 
=2[1 — p(X,¥)] 
implying that 
pP(X,Y) <1 


which completes the proof of Equation (4.2). 

In fact, since Var(Z) = 0 implies that Z is constant with probability 1 (this intu- 
itive relationship will be rigorously proven in Chapter 8), it follows from the proof of 
Equation (4.2) that p(X, Y) = 1 implies that Y = a + bX, where b = oy/ox > O and 
p(X, Y) = —1 implies that Y = a + bX, where b = —o,/o, < 0. We leave it as an 
exercise for the reader to show that the reverse is also true: that if Y =a + bX, then 
p(X, Y) is either +1 or —1, depending on the sign of b. 

The correlation coefficient is a measure of the degree of linearity between X and Y. 
A value of p(X, Y) near +1 or —1 indicates a high degree of linearity between 
X and Y, whereas a value near 0 indicates that such linearity is absent. A positive 
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value of p(X, Y) indicates that Y tends to increase when X does, whereas a negative 
value indicates that Y tends to decrease when _X increases. If p(X, Y) = 0, then X 
and Y are said to be uncorrelated. 


EXAMPLE 4d 
Let J, and Jp be indicator variables for the events A and B. That is, 
{0 if A occurs 
I A= 


0 otherwise 


= 1 if B occurs 
B10 — otherwise 


Then 
ElI4] = P(A) 
E{Izp] = P(B) 
E{L4Ip] = P(AB) 
so 


Cov(I4, Ig) = P(AB) — P(A)P(B) 
= P(B)[P(A|B) — P(A)] 


Thus, we obtain the quite intuitive result that the indicator variables for A and B 
are either positively correlated, uncorrelated, or negatively correlated, depending on 
whether P(A|B) is, respectively, greater than, equal to, or less than P(A). a 


Our next example shows that the sample mean and a deviation from the sample 
mean are uncorrelated. 


EXAMPLE 4e 


Let X1,...,Xn, be independent and identically distributed random variables having 
variance o”. Show that 


Cov(X; — X,X) =0 
Solution. We have 


Cov(X; — X,X) = Cov(X;,X) — Cov(X, X) 


1 = 
= Cov Xi,— DX) — Var(X) 


1X 2 
==) Cow(X,X) — & 
= n 


= _ —0 


n nN 
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where the next-to-last equality uses the result of Example 4a and the final equality 
follows because 


L eee if j # i by independence 
Cov(X;, Xj) = o* ifj=i since Var(X;) =o? 


Although X and the deviation X; — X are uncorrelated, they are not, in gen- 
eral, independent. However, in the special case where the X; are normal random 
variables, it turns out that not only is X independent of a single deviation, but it is 
independent of the entire sequence of deviations X; — X,j = 1,...,n. This result 
will be established in Section 7.8, where we will also show that, in this case, the sam- 
ple mean X and the sample variance S* are independent, with (n — 1)S?/o? having 
a chi-squared distribution with n — 1 degrees of freedom. (See Example 4a for the 
definition of S?.) | 


EXAMPLE 4f 
Consider m independent trials, each of which results in any of r possible outcomes 
iF 


with probabilities P,, P2,..., Pr, )> Pj = 1. If we let Nj,i = 1,...,7, denote the num- 
1 


ber of the m trials that result in outcome i, then Nj, No,...,N; have the multinomial 
distribution 
P(N N N m! ppm... pw 
{Ni =1,N2 = n2,..., ae a 142 °'°4Fy OE 
= 


For i # j, it seems likely that when N; is large, N; would tend to be small; hence, it is 
intuitive that they should be negatively correlated. Let us compute their covariance 
by using Proposition 4.2(iv) and the representation 


m m 
Ni= > oii(k) and N=) Ik) 
k=1 k=1 


where 


fie= 1 if trial k results in outcome i 
"7 ~)0 otherwise 


Pops 1 if trial k results in outcome j 
J"*~ 0 otherwise 


From Proposition 4.2(iv), we have 


m m 


Cov(Ni,Nj) = >>) Covii(k), G(2)) 


é=1 k=1 
Now, on the one hand, when k = £, 


Covi/i(k), Fj(€)) = 0 
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since the outcome of trial & is independent of the outcome of trial €. On the other hand, 


Covii(l), GO) = EUOG(O)] — EVi(COJEU ©] 
= 0 — PP; =—P;P; 


where the equation uses the fact that /;(€)J;(€) = 0, since trial £ cannot result in both 
outcome i and outcome j. Hence, we obtain 


Cov(Nj, Nj) = —mP;P; 


which is in accord with our intuition that N; and N; are negatively correlated. O 


7.5 CONDITIONAL EXPECTATION 


7.5.1 Definitions 


Recall that if X and Y are jointly discrete random variables, then the conditional 
probability mass function of X, given that Y = y, is defined, for all y such that 
P{Y =y} > 0, by 

_ p&,y) 


pxiy@ly) = P{xX =x|Y =y} 
Py\y) 


It is therefore natural to define, in this case, the conditional expectation of X given 
that Y = y, for all values of y such that py(y) > 0, by 


E[X|Y = y] =) xP(X =x1¥ = y} 
= Yo xpxiy (rly) 


EXAMPLE 5a 


If X and Y are independent binomial random variables with identical parameters n 
and p, calculate the conditional expected value of X given that X + Y=m. 


Solution. Let us first calculate the conditional probability mass function of X given 
that X + Y =m. Fork S min(n,m), 


PX =khiX + Yamal ees 


PIX + Y=mj 
PIX =k,Y=m—k} 
~ PIX + Y=m} 
PIX =kP(Y =m — kh 
~ PIX + Y=m}j 


(7) pea = py?-* @ “a ) pF _ pytmrk 


a) pra = p)2n-m 
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where we have used the fact (see Example 3f of Chapter 6) that X¥ + Y is a binomial 
random variable with parameters 2n and p. Hence, the conditional distribution of X, 
given that X + Y =™m, is the hypergeometric distribution, and from Example 2g, we 
obtain 


EIXIX + Y=m)=> Z 


Similarly, let us recall that if X and Y are jointly continuous with a joint probabil- 
ity density function f(x,y), then the conditional probability density of X, given that 
Y =y, is defined, for all values of y such that fy(y) > 0, by 


fy) 
fy) 


fxiy @ly) = 


It is natural, in this case, to define the conditional expectation of X, given that Y = 
y, by 


E[X|Y =y]= il Gav epres 


provided that fy(y) > 0. 


EXAMPLE 5b 
Suppose that the joint density of X and Y is given by 


e*/Ve- 
f(x,y) = —— 0<x<w,0<y<ow 
y 


Compute ELX|Y = y]. 


Solution. We start by computing the conditional density 


fy) 
fry) 
fy) 


/ “ f(x, y) dx 

/ “Cl [yee dx 
_ (/ye*/¥ 
- [ “ye” dx 


y 


fxiy @ly) = 
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Hence, the conditional distribution of X, given that Y = y, is just the exponential 
distribution with mean y. Thus, 


(oe) 
EY == f ~e*l) dx =y a 
0 y 


Remark. Just as conditional probabilities satisfy all of the properties of ordinary 
probabilities, so do conditional expectations satisfy the properties of ordinary expec- 
tations. For instance, such formulas as 


a g(x)pxy (xly) in the discrete case 


E[g(X)¥ =y] =) 100 
/ g(x)fx\y(x|y) dx in the continuous case 
—0o 


and 
n n 
BE) > MY sy| => EY =] 
i=1 i=1 


remain valid. As a matter of fact, conditional expectation given that Y = y can be 
thought of as being an ordinary expectation on a reduced sample space consisting 
only of outcomes for which Y = y. | 


7.5.2 Computing Expectations by Conditioning 


Let us denote by E[X|Y] that function of the random variable Y whose value at Y = y 
is ELX|Y = y]. Note that E[X|Y] is itself a random variable. An extremely important 
property of conditional expectations is given by the following proposition. 


Proposition 5.1. 
E[X] = E[E[X\Y]] (5.1) 
If Y is a discrete random variable, then Equation (5.1) states that 


BX) => AY =y/P(y =} (5.1a) 
y 
whereas if Y is continuous with density fy(y), then Equation (5.1) states 
lee) 
ELX]= [ ELXIY = ylfvoy dy (5.1b) 
—CO 


We now give a proof of Equation (5.1) in the case where X and Y are both discrete 
random variables. 


Proof of Equation (5.1) when X and Y Are Discrete: We must show that 


E[X]=)_ E[X|Y =yI|P(Y =y} (5.2) 


y 
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Now, the right-hand side of Equation (5.2) can be written as 


SEY =yP(Y aye) xP aay arly =y) 
y 


Yat 
P{X =x,Y =y} 

= PIY= 

LL Ryay YA 


=) ixkaarey) 
y Xx 

=) ry Pan a7) 
x y 


=) as) 


= E[X] 


and the result is proved. 


One way to understand Equation (5.2) is to interpret it as follows: To calculate 
E[X], we may take a weighted average of the conditional expected value of X given 
that Y = y, each of the terms E[X|Y = y] being weighted by the probability of 
the event on which it is conditioned. (Of what does this remind you?) This is an 
extremely useful result that often enables us to compute expectations easily by first 
conditioning on some appropriate random variable. The following examples illustrate 
its use. 


EXAMPLE 5c 


A miner is trapped in a mine containing 3 doors. The first door leads to a tunnel that 
will take him to safety after 3 hours of travel. The second door leads to a tunnel that 
will return him to the mine after 5 hours of travel. The third door leads to a tunnel 
that will return him to the mine after 7 hours. If we assume that the miner is at all 
times equally likely to choose any one of the doors, what is the expected length of 
time until he reaches safety? 


Solution. Let X denote the amount of time (in hours) until the miner reaches safety, 
and let Y denote the door he initially chooses. Now, 
E[X) = E(X|¥ =1P{¥Y =1} + BAY =2)P{¥ =2} 
+ E[X|Y = 3]P{Y = 3} 
1 


= 3 AIXIY = 1] + ELX|Y =2] + ELX|Y =3)) 
However, 
E[X|Y =1] =3 
E[X|Y =2]=5 + EX] (5.3) 


E[X|Y =3])=7 + E[X] 


To understand why Equation (5.3) is correct, consider, for instance, E[X|Y = 2] 
and reason as follows: If the miner chooses the second door, he spends 5 hours in 
the tunnel and then returns to his cell. But once he returns to his cell, the prob- 
lem is as before; thus his expected additional time until safety is just E[X]. Hence, 
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E[X|Y = 2] =5 + E[X]. The argument behind the other equalities in Equation (5.3) 
is similar. Hence, 


E[X] = 56 +5 + E[X] + 7+ E[X)) 


or 
B15 | 


EXAMPLE 5d Expectation of a sum of a random number of random variables 


Suppose that the number of people entering a department store on a given day is 
a random variable with mean 50. Suppose further that the amounts of money spent 
by these customers are independent random variables having a common mean of $8. 
Finally, suppose also that the amount of money spent by a customer is also inde- 
pendent of the total number of customers who enter the store. What is the expected 
amount of money spent in the store on a given day? 


Solution. If we let N denote the number of customers that enter the store and_X; the 
amount spent by the ith such customer, then the total amount of money spent can be 


N 
expressed as )> Xj. Now, 
i=l 


N N 


E pe =E|E > XIN 


1 


ra 


But 


which implies that 


e| xin = NE[X] 


Thus, 

e| yo X; | = E[NE[X]] = E[NJE[X] 
Hence, in our example, the expected amount of money spent in the store is 50 X $8, 
or $400. a 


EXAMPLE 5e 


The game of craps is begun by rolling an ordinary pair of dice. If the sum of the dice is 
2, 3, or 12, the player loses. If it is 7 or 11, the player wins. If it is any other number i, 
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the player continues to roll the dice until the sum is either 7 or i. If it is 7, the player 
loses; if it is i, the player wins. Let R denote the number of rolls of the dice in a game 
of craps. Find 

(a) E[R]; 

(b) E[R|player wins]; 

(c) E[R|player loses]. 


Solution. If we let P; denote the probability that the sum of the dice is i, then 


i-1 


P= Pi = Ge ere | 


To compute E[R], we condition on S, the initial sum, giving 
12 
E[R] = >" EIR|S = dP; 
i=2 


However, 


1, if i= 2,3,7,11,12 


E[RIS =i] =} 4 , 


———., otherwise 
Pi + P7 


The preceding equation follows because if the sum is a value 7 that does not end 
the game, then the dice will continue to be rolled until the sum is either 7 or 7, and 
the number of rolls until this occurs is a geometric random variable with parameter 
P; + P7. Therefore, 


6 P. 10 p 
E{[R]=1 : : 
IR] LP +P; LP +P; 
=1 + 23/9 + 4/10 + 5/11) = 3.376 


To determine E[R|win], let us start by determining p, the probability that the player 
wins. Conditioning on S yields 


12 
p=) Plwin|S = iP; 
i=2 
6 10 
P; P; 
=P,+P t P; 4 P; 
_— at” UP +P 
= 0.493 


where the preceding uses the fact that the probability of obtaining a sum of i before 
one of 7 is P;/(P; + P7). Now, let us determine the conditional probability mass 
function of S, given that the player wins. Letting Q; = P{S = i|win}, we have 


Q0,=03=017=0, Q7=P7/p, Qu=Pi/p 
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and, for i = 4,5, 6, 8,9, 10, 
P{S = i, win} 
0; = —————_ 
P{win} 
_ P;P{win|S = i} 
P 
2 
p(Pi + P7) 


Now, conditioning on the initial sum gives 


E[R\win] = )° E[R\win, S = iQ; 


L 


However, as was noted in Example 2] of Chapter 6, given that the initial sum is i, 
the number of additional rolls needed and the outcome (whether a win or a loss) are 
independent. (This is easily seen by first noting that, conditional on an initial sum 
of i, the outcome is independent of the number of additional dice rolls needed and 
then using the symmetry property of independence, which states that if event A is 
independent of event B, then event B is independent of event A.) Therefore, 


E[R|win] = )° E[R|S = iQ; 


6 10 
Q; QO; 
=a 
LRP; LRP; 


= 2.938 
Although we could determine E[R|player loses] exactly as we did E[R|player wins], 
it is easier to use 
E[R] = E[R|win]p + E[R\lose](1 — p) 


implying that 
E[R] — E[R|win]p 


E[R\|lose] = i 
— Pp 


= 3.801 | 


EXAMPLE 5f 


As defined in Example 5c of Chapter 6, the bivariate normal joint density function of 
the random variables X and Y is 


2 
dl 1 xX — bx 2 y — By 
fle.y) = exp | 2 
21 0x0y/1 — p* ee | Ox Oy 


20 (X — Ux)(y — My) 
Oxy 
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We will now show that p is the correlation between X and Y. As shown in Exam- 
ple 5c, uw, = ELX], o = Var(X), and wy = E[Y], o” = Var(Y). Consequently, 
Cov(Xx, Y) 
OxOy 
E[XY] — pxby 


OxOy 


Corr(X, Y) = 


To determine E[XY], we condition on Y. That is, we use the identity 
E[XY] = E[E[XY\Y]] 


Recalling from Example 5c that the conditional distribution of X given that Y = y is 
normal with mean pix. + py — py), we see that 


E[XY|Y = y] = E[Xyl¥ = y] 
= yE|X|Y = y] 


Ox 
=y|uUx + p—( — by) 
Oy 


Ox 2; 
= Yux + p—(y" — pMyy) 
Oy 


Consequently, 
O- 
E[XY|Y] = Ys + p—(¥° — pyY) 
y 
implying that 
O- 
E[X |= | Yi + p—(¥ = my) 
y 
0) 
= MxELY] + p>E[Y? — pyY] 
y 
= Ox 2 2 
= pxpy + os (zLY = 9) 
Ox 
= Pxpfy + p—Var(Y) 
Oy 
= MxMy 1 POxoy 
Therefore, 
Oxo 
Corr(X, Y) = ual p oO 
OxOy 


Sometimes ELX] is easy to compute, and we use the conditioning identity to com- 
pute a conditional expected value. This approach is illustrated by our next example. 


EXAMPLE 5g 

Consider n independent trials, each of which results in one of the outcomes 1,...,k, 
with respective probabilities p1,..., px, ey pi = 1. Let N; denote the number of 
trials that result in outcome i7,i = 1,...,k. Fori # j, find 


(a) E[N,\Ni > 0] and (b) E[LN;\Ni > 1] 
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Solution. To solve (a), let 


Then 
E[Nj] = E[N,\L = O|P{T = 0} + E[N,\Z = 1|P{l=1} 


or, equivalently, 
E[Nj] = E[LNj|Ni = O|P{Ni = 0} + ELNIN; > O|P{N: > 0} 


Now, the unconditional distribution of N; is binomial with parameters n,p;. Also, 
given that N; = r, each of the n — r trials that do not result in outcome i will, 
independently, result in outcome j with probability P(G|not i) = a Consequently, 
the conditional distribution of Nj, given that Nj; = r, is binomial with parameters 


n— Tf, 7. (For a more detailed argument for this conclusion, see Example 4c of 


Chapter 6.) Because P{N; = 0} = (1 — p;)”, the preceding equation yields 
Pj 


all em 
I 


(1 — pi)” + ELNIN:i > OJ —  — p,)” 
giving the result 

lo=aLep) 

b= (= py 


We can solve part (b) in a similar manner. Let 


E[Nj|Ni > 0] = np; 


0, ifN; =0 
J=41, ifN;=1 
2, ifN; > 1 


Then 


E[N;] = E[Nj\J = 0] P{J = 0} + ELNV = 1]P = 1} 
+ E[Nj\J = 2]PU = 2} 
or, equivalently, 
E[N;] = E[Nj|N:i = O]P{N; = 0} + E[N;|N; = 1) P(N; = 1} 
+ E[LNj\Ni > 1]P{N; > 1} 
This equation yields 
Pj n Pj 
1 iy 1 
ar ee ee 


+ E[NjIN:i > 1] — GQ — pa" — npid — pa"!) 


npj=n npi(l — pi"! 
Pi 


giving the result 
npl — Gd — p)** — @ = Ip = pp] 
1—  — pj" — npi. — pir"! 


It is also possible to obtain the variance of a random variable by conditioning. We 
illustrate this approach by the following example. 


ELN\Ni > 1] = 
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EXAMPLE 5h Variance of the geometric distribution 


Independent trials, each resulting in a success with probability p, are successively 
performed. Let N be the time of the first success. Find Var(N). 


Solution. Let Y = 1 if the first trial results in a success and Y = 0 otherwise. Now, 
Var(N) = E[N?] — (E[N])? 
To calculate E[N7], we condition on Y as follows: 
E[N*] = E[E[N*|Y]] 
However, 
E(N7|Y¥ = 1] =1 
E[N?|Y = 0] = E[(1 + N)7] 


These two equations follow because, on the one hand, if the first trial results in a 
success, then, clearly, N = 1; thus, N? = 1. On the other hand, if the first trial results 
in a failure, then the total number of trials necessary for the first success will have the 
same distribution as 1 (the first trial that results in failure) plus the necessary number 
of additional trials. Since the latter quantity has the same distribution as N, we obtain 
E[N?|Y = 0] = E[(. + N)?]. Hence, 


E[N?] = E[N7|Y = 1]P{Y = 1} + E[N?|Y = OJP{Y = 0} 
=p + (i — p)E[( + Ny’) 
=1+ (1 — p)E[2N + N?] 


However, as was shown in Example 8b of Chapter 4, E[N] = 1/p; therefore, 


2d — 
E[N?] =1 4 GaP) | (1 — p)E[N?] 
P 
or > 
E[N?] _ - P 
P 
Consequently, 
Var(N) = E[N’] — (E[N])° 
a) 
a P 
— 
-—? 2 
P 
EXAMPLE 5i 


Consider a gambling situation in which there are r players, with player 7 initially hav- 
ing nj units,n; > 0,7 = 1,...,r. At each stage, two of the players are chosen to play 
a game, with the winner of the game receiving 1 unit from the loser. Any player 
whose fortune drops to 0 is eliminated, and this continues until a single player has all 
n= )-\_,nj units, with that player designated as the victor. Assuming that the results 
of successive games are independent and that each game is equally likely to be won 
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by either of its two players, find the average number of stages until one of the players 
has all n units. 


Solution. To find the expected number of stages played, suppose first that there are 
only 2 players, with players 1 and 2 initially having j and n — j units, respectively. 
Let X; denote the number of stages that will be played, and let m; = ELX;]. Then, for 
j=l,...,n — 1, 
Xj =1+ Aj 
where Aj; is the additional number of stages needed beyond the first stage. Taking 
expectations gives 
mj = 1+ E[Aj] 


Conditioning on the result of the first stage then yields 
m; =1 + E[Aj|1 wins first stage]1/2 + E[Aj|2 wins first stage]1/2 


Now, if player 1 wins at the first stage, then the situation from that point on is exactly 
the same as in a problem which supposes that player / starts with j + 1 and player 2 
with n — (j + 1) units. Consequently, 


E[Aj;|1 wins first stage] = mj+1 
and, analogously, 

E[Aj|2 wins first stage] = mj_1 
Thus, 


1 1 
m= 1 + 5 MH + 5 Mil 


or, equivalently, 
Mo = 2 = By eH 2, Jalan = 1 (5.4) 
Using that mp = 0, the preceding equation yields 


my = 2m, —2 
m3 = 2m. — my — 2=3m, — 6=3(m, — 2) 
m4 =2m3 — m2 — 2=4m, — 12=4(m, — 3) 


suggesting that 
m= itm, — i + 1), (i Dare 7) (5.5) 


To prove the preceding equality, we use mathematical induction. Since we’ve already 
shown the equation to be true for i = 1,2, we take as the induction hypothesis that 
it is true whenever i = 7 < n. Now we must prove that it is true for 7 + 1. Using 
Equation (5.4) yields 


M1 = 2m; — mjy_1 — 2 
=2j(m -—j + )-G - lim -j + 2)-—2 = (by the induction hypothesis) 
=(+ Dm —2 +347 — 34+ 2—2 
=G+ Dm —- 7? -j 
=(7 + Im — jf) 


342 Chapter 7 


Properties of Expectation 


which completes the induction proof of (5.5). Letting i = n in (5.5), and using that 
Mm, = 0, now yields that 
m=n-—1 


which, again using (5.5), gives the result 
m; = i(n — 1) 


Thus, the mean number of games played when there are only 2 players with initial 
amounts i and n — iis the product of their initial amounts. Because both players play 
all stages, this is also the mean number of stages involving player 1. 

Now let us return to the problem involving r players with initial amounts n;,i = 
ene ae nj = n. Let X denote the number of stages needed to obtain a victor, 
and let X; denote the number of stages involving player 7. Now, from the point of 
view of player i, starting with n;, he will continue to play stages, independently being 
equally likely to win or lose each one, until his fortune is either 1 or 0. Thus, the 
number of stages he plays is exactly the same as when he has a single opponent with 
an initial fortune of n — n;. Consequently, by the preceding result it follows that 


E[X;] = ni(n — nj) 


Xe) 
r Tr r 
ee : Scns, aod 2 
E ppe.< = Si nin — nj)=n — Yin; 
i=1 i=1 i=1 


But because each stage involves two players, 


1 r 
aa 


Taking expectations now yields 
1 r 
E[X]= 5 i= Yon} 
i=1 


It is interesting to note that while our argument shows that the mean number of stages 
does not depend on the manner in which the teams are selected at each stage, the 
same is not true for the distribution of the number of stages. To see this, suppose 
r=3,n, =n = 1, and n3 = 2. If players J and 2 are chosen in the first stage, then it 
will take at least three stages to determine a winner, whereas if player 3 is in the first 
stage, then it is possible for there to be only two stages. | 


In our next example, we use conditioning to verify a result previously noted in 
Section 6.3.1: that the expected number of uniform (0, 1) random variables that need 
to be added for their sum to exceed 1 is equal to e. 


EXAMPLE 5j 
Let U,, U2,... be a sequence of independent uniform (0, 1) random variables. Find 
E[N] when 


n 
N=min ny; >1 
i=1 
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Solution. We will find E[N] by obtaining a more general result. For x € [0, 1], let 


n 
N(x) = min 47: baer >x 
i=l 


and set 
m(x) = E[N(x)] 


That is, N(x) is the number of uniform (0, 1) random variables we must add until 
their sum exceeds x, and m/(x) is its expected value. We will now derive an equation 
for m(x) by conditioning on Uj}. This gives, from Equation (5.1b), 


1 
mod = [ E[N(@)|Uj = yl dy (5.6) 


Now, 


PING) =y1=f4 eed (5.7) 


1l+max-—y) ifysx 


The preceding formula is obviously true when y > x. It is also true when y < x, since, 
if the first uniform value is y, then, at that point, the remaining number of uniform 
random variables needed is the same as if we were just starting and were going to add 
uniform random variables until their sum exceeded x — y. Substituting Equation (5.7) 
into Equation (5.6) gives 


m(x)=1 + [one — y)dy 
0 


x 5 
24k i nade by letting 
0 u=x—y 
Differentiating the preceding equation yields 
m' (x) = m(x) 


or, equivalently, 
mx) _, 


m(x) 
Integrating this equation gives 
log[m(x)] =x + c 


or 


m(x) = ke* 
Since m(0) = 1, it follows that k = 1, so we obtain 
m(x) = e 


Therefore, m(1), the expected number of uniform (0, 1) random variables that need 
to be added until their sum exceeds 1, is equal to e. | 
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7.5.3 Computing Probabilities by Conditioning 


Not only can we obtain expectations by first conditioning on an appropriate random 
variable, but we may also use this approach to compute probabilities. To see this, let 
E denote an arbitrary event, and define the indicator random variable X by 


X= 1 if £ occurs 
~ 10 if EF does not occur 


It follows from the definition of X that 


EX =P) 
E[X|Y = y] = P(E|Y =y) for any random variable Y 


Therefore, from Equations (5.1a) and (5.1b), we obtain 


P(E)=)_ P(EIY =y)P(Y = y) if Y is discrete 
y 


. (5.8) 
= i P(E|Y = y)fy(y)dy_ if Y is continuous 
ioe) 


Note that if Y is a discrete random variable taking on one of the values y1,..., yp, 
then, by defining the events F;,i = 1,...,n, by Fj = {Y = yj}, Equation (5.8) reduces 
to the familiar equation 


P(E) = >> P(E\F) PR) 
i=1 


where F,...,F, are mutually exclusive events whose union is the sample space. 


EXAMPLE 5k The best-prize problem 


Suppose that we are to be presented with n distinct prizes, in sequence. After being 
presented with a prize, we must immediately decide whether to accept it or to reject 
it and consider the next prize. The only information we are given when deciding 
whether to accept a prize is the relative rank of that prize compared to ones already 
seen. That is, for instance, when the fifth prize is presented, we learn how it compares 
with the four prizes we’ve already seen. Suppose that once a prize is rejected, it is 
lost, and that our objective is to maximize the probability of obtaining the best prize. 
Assuming that all m! orderings of the prizes are equally likely, how well can we do? 


Solution. Rather surprisingly, we can do quite well. To see this, fix a value k, 0 = 
k <_ n, and consider the strategy that rejects the first k prizes and then accepts the 
first one that is better than all of those first k. Let P;, (best) denote the probability that 
the best prize is selected when this strategy is employed. To compute this probability, 
condition on_X, the position of the best prize. This gives 


Py (best) =)” Py(best|X = i) P(X =i) 
i=] 
Le 

= —)) Px(best|X = i) 


n* 
i=1 
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Now, on the one hand, if the overall best prize is among the first k, then no prize is 
ever selected under the strategy considered. That is, 


P,(bestlLX¥ =i) =0 ifisk 


On the other hand, if the best prize is in position i, where i > k, then the best prize 
will be selected if the best of the first i — 1 prizes is among the first k (for then none 
of the prizes in positions k + 1,k + 2,...,i — 1 would be selected). But, conditional 
on the best prize being in position i, it is easy to verify that all possible orderings of 
the other prizes remain equally likely, which implies that each of the first i — 1 prizes 
is equally likely to be the best of that batch. Hence, we have 


P;(best|X = i) = P{best of first i — 11s among the first k|X = i} 


k 
ae ifi>k 


From the preceding, we obtain 


ae il 
P,(best) = — > 
nN. 


Now, if we consider the function 


x n 
g(x) = — log (7) 
nN x 


; 1 n 1 
g(x) = —log(“) - — 
n x n 


g/x) = 0 log (“) (2527 
x e 


then 


sO 


Thus, since P;(best) © g(k), we see that the best strategy of the type considered is to 
let the first n/e prizes go by and then accept the first one to appear that is better than 
all of those. In addition, since g(n/e) = 1/e, the probability that this strategy selects 
the best prize is approximately 1/e ~ .36788. 


Remark. Most people are quite surprised by the size of the probability of obtain- 
ing the best prize, thinking that this probability would be close to 0 when n is large. 
However, even without going through the calculations, a little thought reveals that 
the probability of obtaining the best prize can be made reasonably large. Consider 
the strategy of letting half of the prizes go by and then selecting the first one to appear 
that is better than all of those. The probability that a prize is actually selected is the 
probability that the overall best is among the second half, and this is 5 In addition, 
given that a prize is selected, at the time of selection that prize would have been 
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the best of more than n/2 prizes to have appeared and would thus have probability of 
at least 5 of being the overall best. Hence, the strategy of letting the first half of all 
prizes go by and then accepting the first one that is better than all of those prizes has 
a probability greater than i of obtaining the best prize. | 


EXAMPLE 51 


Let U be a uniform random variable on (0, 1), and suppose that the conditional dis- 
tribution of X, given that U = p, is binomial with parameters n and p. Find the 
probability mass function of X. 


Solution. Conditioning on the value of U gives 


1 
eee [ P(X = iU = p\fy(p) dp 


1 
/ P(X = ilU =p) dp 
0 


= n! [ Zi saa! 
~ ita — al Jy ? PY ’P 


Now, it can be shown (a probabilistic proof is given in Section 6.6) that 


il(n — 1)! 


1 
i i n-ig = 
[ vc p) “dp = 


Hence, we obtain 


1 
Pix =j= or i=0,...,n 
That is, we obtain the surprising result that if a coin whose probability of coming up 
heads is uniformly distributed over (0, 1) is flipped n times, then the number of heads 
occurring is equally likely to be any of the values 0,...,7. 

Because the preceding conditional distribution has such a nice form, it is worth try- 
ing to find another argument to enhance our intuition as to why such a result is true. 
To do so, let U,U,,..., U, be n + 1 independent uniform (0, 1) random variables, 
and let_X denote the number of the random variables U;,..., U,, that are smaller than 
U. Since all the random variables U, U;,...,U,, have the same distribution, it follows 
that U is equally likely to be the smallest, or second smallest, or largest of them; so 
X is equally likely to be any of the values 0,1,...,”. However, given that U = p, the 
number of the U; that are less than U is a binomial random variable with parameters 
n and p, thus establishing our previous result. | 


EXAMPLE 5m 


Suppose that X and Y are independent continuous random variables having densities 
fx and fy, respectively. Compute P{X < Y}. 


Solution. Conditioning on the value of Y yields 


[oe] 


PIX < Y}= / P(X < Y|Y¥ =ylfy( dy 


2 i PIX < yl¥ = yf) ay 
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CO 
= / P{X < y}fyQ}dy by independence 
CO 


= [| Fxofvoray 
where 

Fxgy =f fiteas a 
EXAMPLE 5n 


Suppose that X and Y are independent continuous random variables. Find the distri- 
bution of X + Y. 


Solution. By conditioning on the value of Y, we obtain 


PLL Y's a= | P(X + Y < alY = y}fy) dy 


—Co 


-| P{X + y < alY = y}fy() dy 


= P(X < a — yify()dy 


-| Fx(a — y)fy(y) dy fl 


7.5.4 Conditional Variance 


Just as we have defined the conditional expectation of X given the value of Y, we can 
also define the conditional variance of X given that Y = y: 


Var(X|Y) = E[(X — E[X|Y])*|¥] 


That is, Var(X|Y) is equal to the (conditional) expected square of the difference 
between X and its (conditional) mean when the value of Y is given. In other words, 
Var(X|Y) is exactly analogous to the usual definition of variance, but now all expec- 
tations are conditional on the fact that Y is known. 

There is a very useful relationship between Var(X), the unconditional variance of 
X,and Var(X|Y), the conditional variance of X given Y, that can often be applied to 
compute Var(X). To obtain this relationship, note first that, by the same reasoning 
that yields Var(X) = E[X?] — (E[X])’, we have 


Var(X|Y) = E[X2|Y¥] — (ELX1Y))” 
SO 


E[Var(X|Y)] = E[E[X?|Y]] — E[(ELX1Y))7] 
= E[X’] — E[(E[X1Y)7] (5.9) 
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Also, since E[E[|X|Y]] = ELX], we have 
Var(E[X|Y]) = E[(E[X|¥])7] — (ELX)? (5.10) 
Hence, by adding Equations (5.9) and (5.10), we arrive at the following proposition. 


Proposition 5.2. The conditional variance formula 
Var(X) = E[Var(X|Y)] + Var(E[X|Y]) 


EXAMPLE 50 


Suppose that by any time ¢ the number of people that have arrived at a train depot is 
a Poisson random variable with mean At. If the initial train arrives at the depot at a 
time (independent of when the passengers arrive) that is uniformly distributed over 
(0, 7), what are the mean and variance of the number of passengers who enter the 
train? 


Solution. For each t = 0, let N(t) denote the number of arrivals by t, and let Y denote 
the time at which the train arrives. The random variable of interest is then N(Y). 
Conditioning on Y gives 


E[N(Y)IY = t] = E[N(IY = 4] 
= E|N()]_ by the independence of Y and N(t) 
= At since N(f) is Poisson with mean At 


Hence, 
E[N(Y)|Y] =aY 


so taking expectations gives 


AT 
E[N(Y)] = AE[Y] = 5 
To obtain Var(N(Y)), we use the conditional variance formula: 


Var(N(Y)|Y¥Y =f = Var(N@|Y =0 
= Var(N(t)) by independence 
=At 


Thus, 


Var(N(Y)|Y) =ay 
E[N(Y)|Y] =aY 


Hence, from the conditional variance formula, 


Var(N(Y)) = E[AY] + Var(rY) 


where we have used the fact that Var(Y) = T? /12. | 
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EXAMPLE 5p Variance of a sum of a random number of random variables 


Let X1, X2,... be a sequence of independent and identically distributed random vari- 
ables, and let N be a nonnegative integer-valued random variable that is independent 
N 
of the sequence Xj,i = 1. To compute Var | >> X; }, we condition on N: 
i=l 


N 
E| 5° XN | = NE[X] 
i=1 


N 
Var | )) XiIN | = NVar(X) 
i=1 
The preceding result follows because, given N, +e , X7 1s just the sum of a fixed num- 
ber of independent random variables, so its expectation and variance are just the 


sums of the individual means and variances, respectively. Hence, from the conditional 
variance formula, 


N 
Var | ))X; | = E[N]Var(X) + (ELX])?Var(N) a 
i=1 


7.6 CONDITIONAL EXPECTATION AND PREDICTION 


Sometimes a situation arises in which the value of a random variable X is observed 
and then, on the basis of the observed value, an attempt is made to predict the value 
of a second random variable Y. Let g(X) denote the predictor; that is, if X is observed 
to equal x, then g(x) is our prediction for the value of Y. Clearly, we would like to 
choose g so that g(X) tends to be close to Y. One possible criterion for closeness is to 
choose g so as to minimize E[(Y — g(X Wale We now show that, under this criterion, 
the best possible predictor of Y is g(X) = E[Y|X]. 

Proposition 6.1. 


E[(Y — g(X))’] = El — E[Y|X))’] 
Proof: 
E\(Y — g(X))*|X] = EY — E[Y|X] + E[Y|X] — g(X)) |X] 
= E[(Y — E[Y|X])*|X] 
+ E[(E[Y|X] — g(X))?|X] 
+ 2E[(Y — E[Y|X](E[Y|X] — g(X))1X] (6.1) 


However, given X, E[Y|X] — g(X), being a function of X, can be treated as a 
constant. Thus, 
El(Y — E[Y|X))(E[Y1X] — g(X))|X] 
= (E[Y|X] — g(X))E[Y — E[Y|X]1X] 
= (E[Y|X] — g(X))(E[Y1X] — E[Y|X])) 
=0 (6.2) 
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Hence, from Equations (6.1) and (6.2), we obtain 
EU(Y — g(X))"|X] = E[Y — E[Y|X] 1X] 


and the desired result follows by taking expectations of both sides of the preceding 
expression. 


Remark. A second, more intuitive, although less rigorous, argument verifying 
Proposition 6.1 is as follows. It is straightforward to verify that E[(Y — c)?] is mini- 
mized at c = E[Y]. (See Theoretical Exercise 1.) Thus, if we want to predict the value 
of Y when there are no data available to use, the best possible prediction, in the 
sense of minimizing the mean square error, is to predict that Y will equal its mean. 
However, if the value of the random variable X is observed to be x, then the predic- 
tion problem remains exactly as in the previous (no-data) case, with the exception 
that all probabilities and expectations are now conditional on the event that XY = x. 
Hence, the best prediction in this situation is to predict that Y will equal its condi- 
tional expected value given that X = x, thus establishing Proposition 6.1. | 


EXAMPLE 6a 


Suppose that the son of a man of height x (in inches) attains a height that is normally 
distributed with mean x + 1 and variance 4. What is the best prediction of the height 
at full growth of the son of a man who is 6 feet tall? 


Solution. Formally, this model can be written as 
Y=X-+i1¢+e 


where e is a normal random variable, independent of X, having mean 0 and variance 
4. The X and Y, of course, represent the heights of the man and his son, respectively. 
The best prediction E[Y|X = 72] is thus equal to 


E[Y|X = 72] = E[X + 14+ eX =72] 
= 73 + Efe|X = 72] 
= 73 + E(e) by independence 
= 73 | 


EXAMPLE 6b 


Suppose that if a signal value s is sent from location A, then the signal value received 
at location B is normally distributed with parameters (s, 1). If S, the value of the signal 
sent at A, is normally distributed with parameters (j1,07), what is the best estimate of 
the signal sent if R, the value received at B, is equal to r? 


Solution. Let us start by computing the conditional density of S given R. We have 


_ fs,r,1) 
fsir (lr) = “Gy 

_ fs(s)fris@ls) 
fRO) 


— Keo -#)?/20? g-(r-s)?/2 
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where K does not depend on s. Now, 


@-we @-9 oft 71 a ce 
202 2 =H hog 3 oe. alee 


4+ o2 2 
Z l+o 2% w+ ro re 
202 1+ 02 
1+ 0? (uw + ro?) 
+ C2 
202 1+ 02 
where Cy and C2 do not depend on s. Hence, 
(u + ro?) 
1+ 02 
fsir(s|r) = C exp ; 
Oo 


where C does not depend on s. Thus, we may conclude that the conditional distribu- 
tion of S, the signal sent, given that r is received, is normal with mean and variance 
now given by 


pw + ro 
E[S|R = r] = ———- 
[SIR=]= 5-3 
2 
Var(S|R =r) = 
ar(S| r) a 


Consequently, from Proposition 6.1, given that the value received is r, the best esti- 
mate, in the sense of minimizing the mean square error, for the signal sent is 


1 o2 


r 
toe 1+ 02 


ELS|R =r) = 


Writing the conditional mean as we did previously is informative, for it shows that it 
equals a weighted average of jz, the a priori expected value of the signal, and r, the 
value received. The relative weights given to w and r are in the same proportion to 
each other as 1 (the conditional variance of the received signal when s is sent) is to 0” 
(the variance of the signal to be sent). | 


EXAMPLE 6c 


In digital signal processing, raw continuous analog data X must be quantized, or dis- 
cretized, in order to obtain a digital representation. In order to quantize the raw 


data X, an increasing set of numbers qj,i = 0,+1,+2,...,such that lim a; = co and 
i— +00 
lim aj; = —oo is fixed, and the raw data are then quantized according to the interval 
i—>—oo 


(aj, 4:41] in which X lies. Let us denote by y; the discretized value when X € (aj, 4;+4], 
and let Y denote the observed discretized value—that is, 


Y=y; ifa,< XS ai+1 
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The distribution of Y is given by 


P{Y = yi} = Fx(ai41) — Fr(ai) 


Suppose now that we want to choose the values y;,i = 0,£1,+2,...so as to mini- 
mize E[(X — Y)*], the expected mean square difference between the raw data and 
their quantized version. 


(a) Find the optimal values y;,i = 0,+1,.... 

For the optimal quantizer Y, show that 
(b) E[Y] = ELX], so the mean square error quantizer preserves the input mean; 
(c) Var(Y) = Var(X) — E[(X — Y)’]. 


Solution. (a) For any quantizer Y, upon conditioning on the value of Y, we obtain 
E[((X — Y)’]= EX — yi" lay < X = ays] Pla; < X = ais) 
i 
Now, if we let 
I=i ifa < X = aj4) 
then 
EU(X — yi)"lai < X = aia) = EX — yi) =i] 
and by Proposition 6.1, this quantity is minimized when 
yi = E[X| = i] 
= E[X |aj <XS ai+1| 


_ [ xfx (x) dx 
Ja Fx (ini) — Fx (ai) 


Now, since the optimal quantizer is given by Y = E[X|/], it follows that 
iO E[Y] = E[X] 
Cc 
Var(X) = E[Var(X|D] + Var(ELX|/]) 
= E[E[(X — Y)*|J]] + Var(Y) 


= E[(X — Y)*] + Var(Y) = 


It sometimes happens that the joint probability distribution of X and Y is not 
completely known; or if it is known, it is such that the calculation of E[Y|X = x] 
is mathematically intractable. If, however, the means and variances of X and Y and 
the correlation of X and Y are known, then we can at least determine the best linear 
predictor of Y with respect to X. 

To obtain the best linear predictor of Y with respect to XY, we need to choose a and 
b so as to minimize E[(Y — (a + bX))*]. Now, 


EY = (+ BOP) HBV = oY = ObXY + a + DabX + bX" | 
= E[Y’] — 2aE[Y] — 2bE[XY] + a* 
+ 2abE[X] + b°E[X?7] 
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Taking partial derivatives, we obtain 


2 nw — a — bX)] = -2E[Y] + 2a + 2bE[X] 
7 (6.3) 
ap EL — a — bX)] = -2E[XY] + 2aE[X] + 2bE[X?] 


Setting Equations (6.3) to 0 and solving for a and b yields the solutions 


_ ELXY] — ELXJE[Y] _ Cov(X,Y) _ 5 


E[X2] — (ELX])2 o2 Ox 
poyE[X] 


(6.4) 
a= E[Y] — bE[X]= E[Y] — 


Ox 
where p = Correlation(X, Yo; = Var(Y), and oy = Var(X). It is easy to ver- 
ify that the values of a and b from Equation (6.4) minimize E[(Y — a — bX)?]; 
thus, the best (in the sense of mean square error) linear predictor Y with respect 


to X is 


po. 
by + — (xX — px) 


Ox 


where pry = E[Y] and py = ELX]. 
The mean square error of this predictor is given by 


Oy 2 
E\\|Y My S (Xx Hx) 


=E|[(Y - wy] + 0? 


mre | ee 


E[(& ~ wxy"] — 20 E[(Y — wy) — ms)] 


= 42 (a ne eee 
= oy + proy 2p" oy 


=o,(1 — p”) (6.5) 


We note from Equation (6.5) that if o is near +1 or —1, then the mean square error 
of the best linear predictor is near zero. w 


EXAMPLE 6d 


An example in which the conditional expectation of Y given X is linear in X, and 
hence in which the best linear predictor of Y with respect to X is the best overall 
predictor, is when X and Y have a bivariate normal distribution. For, as shown in 
Example Sc of Chapter 6, in that case, 


Oy 
E[Y|X =x] = py + p—(X — bx) a 
x 
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7.7 MOMENT GENERATING FUNCTIONS 


The moment generating function M(t) of the random variable X is defined for all real 
values of t by 


M(t) = Efe] 
Pa e™ p(x) if X is discrete with mass function p(x) 
x 


(oe) 
/ e“f(x) dx if X is continuous with density f(x) 


—oo 


We call M(t) the moment generating function because all of the moments of X can be 
obtained by successively differentiating M(t) and then evaluating the result at t = 0. 
For example, 


/ — d tX 
M(t) = ale ] 


=2[ | (7.1) 
= E[Xe*] 


where we have assumed that the interchange of the differentiation and expectation 
operators is legitimate. That is, we have assumed that 


d Xx d xX 
A LF Pe =) gle’ 


x 


in the discrete case and 


d d 
a | é* F(x) ax| = / qe f@lax 


in the continuous case. This assumption can almost always be justified and, indeed, is 
valid for all of the distributions considered in this book. Hence, from Equation (7.1), 
evaluated at t = 0, we obtain 


M'(0) = E[X] 
Similarly, 


WW d a 
M"®) = 7M 


d 
— —Elxe'* 
qe | 


= @ ix 
= [Sexe] 
== Bixee | 
Thus, 
M" (0) = E[X?] 
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In general, the nth derivative of M(f) is given by 
M"(t) = E[X"e*] n=1 


implying that vi en ; 
M'(0)=E n= 


We now compute M(t) for some common distributions. 
EXAMPLE 7a Binomial distribution with parameters n and p 
If X is a binomial random variable with parameters n and p, then 


M(t) = Efe*] 


n 


where the last equality follows from the binomial theorem. Differentiation yields 
M(t) = n(pe! + 1 — p)"'pe! 


Thus, 
E[X] = M'(0) = np 


Differentiating a second time yields 
M"(t) =n(n — 1)(pe' + 1 — py"? (pe)” + n(pel + 1 — p)"!pe! 


so 
E[X?] = M"(0) = n(n — Dp? + np 


The variance of X is given by 


Var(X) = E[X*] — (E[X])* 


=n(n — 1p? + np — n’p* 
=np(1 — p) 
verifying the result obtained previously. | 


EXAMPLE 7b Poisson distribution with mean i 
If X is a Poisson random variable with parameter A, then 
M(t) = Efe] 
oo elte-Ajyn 


n! 
n=0 


[oe) 
=e 


n=0 


(Ae‘)” 
n! 
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= erent’ 
= exp{a(e’ — 1} 
Differentiation yields 
M'(t) = re’ exp{r(e’ — 1)} 
M"(t) = (Ae')* exp{a(e’ — 1)} + Ae’ exp{a(e’ — 1} 
Thus, 
E[X] = M’(0) =a 
E[X7] = M"(0) =27 +A 
Var(X) = E[X?] — (E[X)” 
=X 


Hence, both the mean and the variance of the Poisson random variable equald. 


EXAMPLE 7c Exponential distribution with parameter i 
M(t) = Efe*] 


CO 
= ere" dx 
0 


We note from this derivation that, for the exponential distribution, M(d) is defined 
only for values of ¢ less than 4. Differentiation of M(a) yields 


M(t) = ——., _ M'(H= ee 
A A 
Hence, 


1 2 
E xX => i 0 == E 2 =— ld (0) —————— 
[X]J=MO=> EX ]=M'O=5 
The variance of X is given by 


Var(X) = ELX2] — (E[X))? 
1 


EXAMPLE 7d Normal distribution 


We first compute the moment generating function of a unit normal random variable 
with parameters 0 and 1. Letting Z be such a random variable, we have 


Mz(t) = Ele] 


2 
Ix px /2 dx 


1 oo 
— a e 
Vv 20 he 
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7 V2m Joo 2 2 
a a i 8 pO gy 

21 J—oco 
= ee l2 


Hence, the moment generating function of the unit normal random variable Z is given 


by Mz(t) = e/2. To obtain the moment generating function of an arbitrary normal 
random variable, we recall (see Section 5.4) that XY = w + oZ will have a normal 
distribution with parameters j: and o? whenever Z is a unit normal random variable. 
Hence, the moment generating function of such a random variable is given by 


Mx(t) = Ele] 
_— Efete4)] 
_ Efe“ e!?7] 
= gh Eie?*| 
= eM7(to) 


= ett eta) /2 
ot? 
= €xP) > + mt 


By differentiating, we obtain 


242 
i 2 ot 
M(t) = (u + to yexn | ~ al 


242 oye) 
1 22 o*t 2 o-t 
x) = (uw + to*) exo | + ul +o oo | + al 
Thus, 
E[X?] = M’(0) = w? + o? 
implying that 
Var(X) = E[X*] — E([X])’ 


Tables 7.1 and 7.2 give the moment generating functions for some common dis- 
crete and continuous distributions. 

An important property of moment generating functions is that the moment gen- 
erating function of the sum of independent random variables equals the product of 
the individual moment generating functions. To prove this, suppose that X and Y are 
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TABLE 7.1: DISCRETE PROBABILITY DISTRIBUTION 


Moment 
Probability mass generating 
function, p(x) function, M(t) Mean Variance 
Binomial with (") pd — p)"* (pe’ +1 — p)" np np(1 — p) 
parameters n, p; 
0O<pe<l e= 0A 
* 
Poisson with et exp{a(el — 1)} a rN 
parameter A > 0 is 
c= 0,152: 
f 1 1- 
Geometric with pa. = py oe ; as 
parameter 1—- (1 — pie e P 
0O<psl x=1,2,... 
_ t " 1- 
Negative é 7 i) gil = pent pe | r r( : P) 
binomial with Lape Pp 


parameters r, p; 
O=p=1 n=r,r+1,... 


independent and have moment generating functions My(t) and My(d), respectively. 
Then Myiy(), the moment generating function of X + Y, is given by 


Mxyy@ = Efe] 
= E[e*e™] 
= Efe ]E[e” ] 
= Mx()My(t) 


where the next-to-last equality follows from Proposition 4.1, since X and Y are inde- 
pendent. 

Another important result is that the moment generating function uniquely deter- 
mines the distribution. That is, if Mx(¢) exists and is finite in some region about t = 0, 
then the distribution of X is uniquely determined. For instance, if 


1\10 
Mx) = (5) Cae as 
then it follows from Table 7.1 that X is a binomial random variable with parameters 


1 
10 and oe 


EXAMPLE 7e 


Suppose that the moment generating function of a random variable X is given by 
M(t) = 8@-), What is PLX = 0}? 


TABLE 7.2: CONTINUOUS PROBABILITY DISTRIBUTION 


Uniform over (a, b) 


Exponential with 
parameter A > 0 


Gamma with parameters 
(s,A),A > 0 


Normal with parameters 
(u,07) 


Probability mass function, f(x) 


fi)=}b—a 
0 


rare | 


f@= 

0 

1 
f(x) = Jin 


1 


a<x<b 


otherwise 


he** x = 0 


0 


hee (Axo! 


x <0 


x20 
T(s) 


x <0 


2 
eH)? /20 


-~-wo<x < wo 


Moment 
generating 
function, M(t) 


eb — ela 

t(b — a) 
Xr 

A-t¢t 


Mean Variance 
a+b (b — a? 
2 12 
1 1 
x Ne 
s Ss 
x Ne 
mn a 


LL Uolpas 


suolouny Bulyesauay JUdWO/\ 


6SE 
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Solution. We see from Table 7.1 that M(t) = &—» is the moment generating func- 
tion of a Poisson random variable with mean 3. Hence, by the one-to-one correspon- 
dence between moment generating functions and distribution functions, it follows 
that X must be a Poisson random variable with mean 3. Thus, P(X = 0} = e~>. | 


EXAMPLE 7f Sums of independent binomial random variables 


If X and Y are independent binomial random variables with parameters (n, p) and 
(m, p), respectively, what is the distribution of XY + Y? 


Solution. The moment generating function of X + Y is given by 


Mx+y) = Mx()My() = (pe +: 1 = p)"(pe’ +. 1 — py” 
= (pe + 1 — py" 


However, (pe’ + 1 — p)'"*” is the moment generating function of a binomial ran- 
dom variable having parameters m + n and p. Thus, this must be the distribution 
of X¥ + Y. | 


EXAMPLE 7g Sums of independent Poisson random variables 


Calculate the distribution of X + Y when X and Y are independent Poisson random 
variables with means respective A; and Aj. 


Solution. 


Mxyyy( = Mxy(OMy(h) 
exp{Ai(e’ — 1}exp{az(e’ — 1)} 
= exp{(Ay + Aa)(e" — 1} 


Hence, X + Y is Poisson distributed with mean A; + Az, verifying the result given 
in Example 3e of Chapter 6. ai 


EXAMPLE 7h Sums of independent normal random variables 


Show that if X and Y are independent normal random variables with respective 


parameters (141,07) and (142,03), then XY + Y is normal with mean yy + m2 and 


variance o; + a, 


Solution. 


Mysyy() = MxOMy() 


o2t2 o2t2 
=exp)—5— + mitpexpy—— + mat 


(07 + 05) 
acs 2) un ea + (U1 + ba)t 
which is the moment generating function of a normal random variable with mean 
fy + [2 and variance oF + oF. The desired result then follows because the moment 
generating function uniquely determines the distribution. Oo 
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EXAMPLE 7i 


Compute the moment generating function of a chi-squared random variable with n 
degrees of freedom. 


Solution. We can represent such a random variable as 
Zot + Z 


where Z1,...,Z, are independent standard normal random variables. Let M(t) be its 
moment generating function. Then, by the preceding, 


M(t) = (Efe ])" 
where Z is a standard normal random variable. Now, 


Efe 2") gr e-/2 dx 


Tac 


: “ -x’/20° dy where o2 (ltat 
— e~ x olds 
J 20 —oo 
=o 
=(1 — 2971 


where the next-to-last equality uses the fact that the normal density with mean 0 and 
variance o integrates to 1. Therefore, 


M®=( — 217" | 


EXAMPLE 7j Moment generating function of the sum of a random number of 
random variables 


Let X1, X2,... be a sequence of independent and identically distributed random vari- 
ables, and let N be a nonnegative, integer-valued random variable that is independent 
of the sequence X,i = 1. We want to compute the moment generating function of 


N 
Y= bee:« 
i=l 


(In Example 5d, Y was interpreted as the amount of money spent in a store on a 
given day when both the amount spent by a customer and the number of customers 
are random variables.) 

To compute the moment generating function of Y, we first condition on N as 
follows: 


N n 
E'| exp ty % N=n|=E| exp t) > Xx; N=n 
1 1 


stleasleee || 
id eal 


= [Mx(]" 
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where 
Mx(t) = Efe] 
Hence, 
Ele |N] = (Mx) 
Thus, 


My(t) = E[(Mx(0)"] 
The moments of Y can now be obtained upon differentiation, as follows: 
My (t) = E[N(Mx()" My] 
So 
E[Y] = MY (0) 
= E[N(Mx(0))*~' My (0)] 
= E[NEX] (7.2) 
= E[N]E[X] 
verifying the result of Example 5d. (In this last set of equalities, we have used the fact 
that My (0) = Efe°*] = 1.) 
Also, 
YO = EINWN — 1)(Mx(0)** (My)? + Nx)" MO] 
so 
E[Y*] = M0) 
= E[N(N — 1)(E[X])* + NE[X?]] 
= (E[X])*(E[N?] — E[N]) + E[NJELX?] (7.3) 
= E[N\(E[X*] — (E[X))*) + (EX) E[N7] 
= E[N]Var(X) + (E[X])’E[N7] 


Hence, from Equations (7.2) and (7.3), we have 


Var(Y) = E[N]Var(X) + (E[X])?(E[N*] — (E[N)”) 
= E[N]Var(X) + (E[X])?Var(N) | 


EXAMPLE 7k 


Let Y denote a uniform random variable on (0, 1), and suppose that, conditional on 
Y = p, the random variable X has a binomial distribution with parameters n and p. 
In Example 5k, we showed that X is equally likely to take on any of the values 
0,1,...,”. Establish this result by using moment generating functions. 


Solution. To compute the moment generating function of X, start by conditioning 
on the value of Y. Using the formula for the binomial moment generating function 
gives 

Ele*|¥ = p] = (pe + 1 — p)” 
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Now, Y is uniform on (0, 1), so, upon taking expectations, we obtain 
1 
Efe*] = i: (pe! + 1 — p)"dp 
0 


t 


é 
/ y"dy (by the substitution y = pe’ + 1 — p) 
1 


e — 1 
1 elm) 4 
n+1 eé-1 


n+1 


Because the preceding is the moment generating function of a random variable that 
is equally likely to be any of the values 0,1,...,, the desired result follows from the 
fact that the moment generating function of a random variable uniquely determines 
its distribution. | 


7.7.1. Joint Moment Generating Functions 


It is also possible to define the joint moment generating function of two or more 


random variables. This is done as follows: For any n random variables X1,...,Xn, 
the joint moment generating function, M(t,,...,%,), is defined, for all real values of 
t1,..-,tn, by 


M(t, ...,tn) = EletXit +inXn] 


The individual moment generating functions can be obtained from M(t,,...,t,) by 
letting all but one of the ¢;’s be 0. That is, 


My,(t) = Efe*'] = M(0,...,0, t, 0,...,0) 


where the ¢ is in the ith place. 

It can be proven (although the proof is too advanced for this text) that the joint 
moment generating function M(t,,...,t,) uniquely determines the joint distribution 
of X1,...,X;,. This result can then be used to prove that the n random variables 
X1,...,Xn are independent if and only if 


M(t,...,tn) _ Mx, (t1) ike - Mx, (tn) (7.4) 
For the proof in one direction, if the n random variables are independent, then 


M(th,..-5tn) = Elet*1t  tn%n)y 
= E[e* hs elnXn) 
= Efe]... E[e*"]__ by independence 
= Mx,(t)--- Mx, (tn) 


For the proof in the other direction, if Equation (7.4) is satisfied, then the joint 
moment generating function M(t,,...,t,) is the same as the joint moment generating 
function of n independent random variables, the ith of which has the same distri- 
bution as X;. As the joint moment generating function uniquely determines the joint 
distribution, this must be the joint distribution; hence, the random variables are 
independent. 
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EXAMPLE 71 


Let X and Y be independent normal random variables, each with mean wp and vari- 
ance o. In Example 7a of Chapter 6, we showed that ¥ + Y and X — Y are inde- 
pendent. Let us now establish this result by computing their joint moment generating 
function: 


Beet Oe”) _ Berea) 


_ Ele pie et] 
= elu(t+s)+o7(t+s)"/26u (t—s)+o2(t—s)? /2 


= e2uttorr ,07s° 

But we recognize the preceding as the joint moment generating function of the sum 
of a normal random variable with mean 2 and variance 2c” and an independent 
normal random variable with mean 0 and variance 207. Because the joint moment 
generating function uniquely determines the joint distribution, it follows that X¥ + Y 
and X — Y are independent normal random variables. a 


In the next example, we use the joint moment generating function to verify a result 
that was established in Example 2b of Chapter 6. 


EXAMPLE 7m 


Suppose that the number of events that occur is a Poisson random variable with 
mean A and that each event is independently counted with probability p. Show that 
the number of counted events and the number of uncounted events are independent 
Poisson random variables with respective means Ap and A(1 — p). 


Solution. Let X denote the total number of events, and let X, denote the number 
of them that are counted. To compute the joint moment generating function of X¢, 
the number of events that are counted, and_Y — _X,, the number that are uncounted, 
start by conditioning on X to obtain 


Eles*et#X-Xo x = n| = el” Efes-9Xe1 x = n| 
e (pest + 1 _ py" 
= (pe + (1 — pie’y” 


II 


which follows because, conditional on X = n,X; is a binomial random variable with 
parameters v and p. Hence, 


Ele ere) X] = pe’ + (= pley* 
Taking expectations of both sides of this equation yields 
EfeXeH&-X0)] = El(pe’ {l= pye')*] 


Now, since X is Poisson with mean A, it follows that E[e*] = e-), Therefore, for 
any positive value a we see (by letting a = e’) that E[a*] = e+. Thus 
Efe *ett(X-Xe)] — ghee +A—p)e'—1) 


— P(e!) 64d —p)(e'—-1) 
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As the preceding is the joint moment generating function of independent Poisson 
random variables with respective means Ap and A(1 — p), the result is proven. a 


7.8 ADDITIONAL PROPERTIES OF NORMAL RANDOM VARIABLES 


7.8.1 The Multivariate Normal Distribution 


Let Z1,...,Z, be a set of n independent unit normal random variables. If, for some 
constants aj,1 S<ism,1 Sj Sn,andyj,1 Ssism, 


X=ayZ, +++) + AnZn + pb 


X72 = 4712, + +++ + AanZn + p22 
Xj = ayyZ, + +++ + AinZn + bi 


Xm = 4niZ1 + +++ + GunZn + Um 


then the random variables X1,...,Xj,, are said to have a multivariate normal distri- 
bution. 

From the fact that the sum of independent normal random variables is itself a 
normal random variable, it follows that each Xj is a normal random variable with 
mean and variance given, respectively, by 


ELXi] = wi 
n 
2 
Var(X;) = > aij 
j=l 
Let us now consider 
M(t,...,tm) = Elexp{.X1 + +++ + tnXm}] 
the joint moment generating function of X1,...,Xm. The first thing to note is that 
m 
since }° 4X; is itself a linear combination of the independent normal random vari- 


i=1 
ables Z1,..., Zn, it is also normally distributed. Its mean and variance are 


m m 
E » Xj | = a tii 
i=1 i=l 


and 


m m m 
Var t:X; | = Cov 2 Xj, > AG 


i=1 j=l 
mm 
= - 2 tit; Cov( Xj, Xj) 
i=1 


i j=1 


— 
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Now, if Y is a normal random variable with mean jz and variance o”, then 


Ele’ ] = My())|ma1 = et? 2 


Thus, 
m 1 m m 
M(t,...,tm) = exp dts + 5 2 D> tiljCov(X;, Xj) 
i=1 i=1 j=1 
which shows that the joint distribution of X1,...,Xm is completely determined from 


a knowledge of the values of ELX;] and Cov(Xj, Xj), i,j = 1,...,m. 
It can be shown that when m = 2, the multivariate normal distribution reduces to 
the bivariate normal. 


EXAMPLE 8a 
Find P(X < Y) for bivariate normal random variables X and Y having parameters 
jx = E[X], wy = E[Y], 0? = Var), of = Var(Y), p = Corr(X, Y) 
Solution. Because X — Y is normal with mean 
ELX — Y]= ux — py 
and variance 
Var(X — Y) = Var(X) + Var(—Y) + 2Cov(X,—Y) 
= o2 + o, — 2poxoy 
we obtain 


Ax 2Viery —yY <0} 


= X — Y — We = by) © —(ux — My) 
(ae + of — 2poxoy (3 + of — 2poxoy 

—©o My — Px a 
(2 + Oy — 2p0xoy 


EXAMPLE 8b 


Suppose that the conditional distribution of X, given that © = 6, is normal with 
mean 6 and variance 1. Moreover, suppose that © itself is a normal random variable 
with mean jz and variance o”. Find the conditional distribution of © given that X¥ = x. 


Solution. Rather than using and then simplifying Bayes’s formula, we will solve this 
problem by first showing that_X, © has a bivariate normal distribution. To do so, note 
that the joint density function of X, © can be written as 


fx,o(x, 9) = fxjo 0) fo) 


where fy|@(x|@) is anormal density with mean 6 and variance 1. However, if we let Z 
be a standard normal random variable that is independent of ©, then the conditional 
distribution of Z + ©, given that © = @, is also normal with mean @ and variance 1. 
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Consequently, the joint density of Z + ©, © is the same as that of X, ©. Because the 
former joint density is clearly bivariate normal (since Z + © and © are both linear 
combinations of the independent normal random variables Z and ©), it follows that 
X,@ has a bivariate normal distribution. Now, 
E[X] = E[Z + OJ = 
Var(X) = Var(Z + @)=1 + o? 


and 


p = Corr(X, ©) 
= Corr(Z + ©,0) 
7 Cov(Z + 0,0) 
~ J/Var(Z + 0)Var(@) 
(oR 


~ Lee 


Because X,@ has a bivariate normal distribution, the conditional distribution of ©, 
given that X = x, is normal with mean 


Var(O 
E[@|X = x] = E[@] 4 ple (x — ELX) 


oO 
ian i) 


and variance 


Var(@|X = x) = Var(®)(1 — p”) 


2 
Oo 
= | 
1+ 02 
7.8.2 The Joint Distribution of the Sample Mean and Sample Variance 
Let X1,...,Xn be independent normal random variables, each with mean yw and vari- 


ance o*. Let X¥ = > Xj /n denote their sample mean. Since the sum of independent 
i=1 
normal random variables is also a normal random variable, it follows that X is a nor- 
mal random variable with (from Examples 2c and 4a) expected value x and variance 
2 
o*/n. 
Now, recall from Example 4e that 


Cov(X, X; — X)=0, i=1,...,n (8.1) 


Also, note that since X¥,X, — X,X2 — X,...,X, — X are all linear combinations 
of the independent standard normals (X; — j1)/o,i=1,...,n, it follows that X, X; — 
X,i = 1,...,n has a joint distribution that is multivariate normal. If we let Y be 
a normal random variable, with mean jz and variance o” /n, that is independent of 
the X;,i = 1,...,n, then Y,X; — X,i = 1,...,n also has a multivariate normal dis- 
tribution and, indeed, because of Equation (8. 3.1), has the same expected values and 
covariances as the random variables X,X; — X,i=1,...,n. But since a multivariate 
normal distribution is determined completely by its expected values and covariances, 
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it follows that Y,X; — X,i = 1 4a este ond X,X; — X,i = 1,...,n have the same 
joint distribution, thus showing that X is independent of the sequence of deviations 
A = Les call _ 

Since X is independent of the sequence of deviations X; — X,i=1,...,n,itis also 

n _ 
independent of the sample variance S= V(X - X " /(n — 1). 
i=1 

Since we already know that X is normal with mean and variance o7/n, it remains 
only to determine the distribution of S*. To accomplish this, recall, from Example 4a, 
the algebraic identity 


(n — 1)S? = Da - ay 


=> By? — n(X — py? 


Upon dividing the preceding equation by o”, we obtain 


ot 2 xX — a 8 _ 2 
cere ce o 


a) 


i=1 


Now, 


is the sum of the squares of m independent standard normal random variables and so 
is a chi-squared random variable with n degrees of freedom. Hence, from Example 7i, 
its moment generating function is (1 — 2f)~”/ 2. Also, because 


_ 2 
xX — yt 
(i) 


is the square of a standard normal variable, it is a chi-squared random variable with 
1 degree of freedom, and so has moment generating function (1 — 21)~'/?. Now, we 
have seen previously that the two random variables on the left side of Equation (8.2) 
are independent. Hence, as the moment generating function of the sum of indepen- 
dent random variables is equal to the product of their individual moment generating 
functions, we have 


Elet-DS°/07) (4 _ ary-1/2 = an—n/2 


or 
Elel@-DS°/0*) = fal _ 2f)-@-DP 


But as (1 — 24)~~/? is the moment generating function of a chi-squared random 
variable with n — 1 degrees of freedom, we can conclude, since the moment gener- 
ating function uniquely determines the distribution of the random variable, it follows 
that that is the distribution of (n — 1)S?/o?. 

Summing up, we have shown the following. 
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Proposition 8.1. If X1,...,X, are independent and identically distributed normal 
random variables with mean jz and variance o”, then the sample mean X and the 
sample variance S” are independent. X is a normal random variable with mean jz and 
variance o7/n; (n — 1)S*/o* is a chi-squared random variable with n — 1 degrees of 
freedom. 


7.9 GENERAL DEFINITION OF EXPECTATION 


Up to this point, we have defined expectations only for discrete and continuous ran- 
dom variables. However, there also exist random variables that are neither discrete 
nor continuous, and they, too, may possess an expectation. As an example of such a 
random variable, let XY be a Bernoulli random variable with parameter p = 5 and let 
Y be a uniformly distributed random variable over the interval [0, 1]. Furthermore, 
suppose that X and Y are independent, and define the new random variable W by 


X ifX=1 
w={y ifX 41 


Clearly, W is neither a discrete (since its set of possible values, [0, 1], is uncountable) 
nor a continuous (since P{W = 1} = 5) random variable. 

In order to define the expectation of an arbitrary random variable, we require the 
notion of a Stieltjes integral. Before defining this integral, let us recall that, for any 


function g, [ 7 g(x) dx is defined by 


b n 
[sede = tim ¥ gtene — 21-0 
a i=l 


where the limit is taken over alla = x9 < x1 < X2°:+ < X, = basn—-oo and where 
max (xj — X;_1)—0. 
ae 7) 


For any distribution function F’, we define the Stieltjes integral of the nonnegative 
function g over the interval [a, b] by 


b n 
/ g(x) dF(x) = lim )* gx) [F@i) — Fej-1)] 
o i=1 
where, as before, the limit is taken over alla = x9 < x1 < ++: < X,» = basn—-ooand 


where max (x; — xj-1)—>0. Further, we define the Stieltjes integral over the whole 
i=1 664 n 


real line by 


oe) b 
/ g(x) dF(x) = lim / g(x) dF(x) 
oe) a> —w Ja 


b> + 
Finally, if g is not a nonnegative function, we define gt and g~ by 
0 ifg(x) < 0 


0 ifg~) =0 
—g(x) ifg(x) < 0 


gt(x) = ae if g(x) = 0 


ro=| 
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Because g(x) = gt (x) — g (x) and gt and g” are both nonnegative functions, it is 
natural to define 


/ g(x) d(x) = / gt (x) dF(x) -{ g(x) dF(x) 


—oo ae 


and we say that [°° g(x) dF (x) exists as long as [°° gt (x) dF(x) and [°°. g~ (x) dF(x) 
are not both equal to +o. 

If X is an arbitrary random variable having cumulative distribution F, we define 
the expected value of X by 


E|X]= [- x dF (x) (9.1) 


—Co 


It can be shown that if X is a discrete random variable with mass function p(x), then 


[- xdF (x) = ». xp(x) 


es x:p(x)>0 


whereas if X is a continuous random variable with density function f(x), then 


[oe) [ee 
i xdF (x) = / xf (x) dx 
—oo —oo 
The reader should note that Equation (9.1) yields an intuitive definition of E[X]; 
consider the approximating sum 


> alF@) — Fees) 
i=1 


of E[X]. Because F(xj) — F(x;_1) is just the probability that X will be in the interval 
(x;_1,x;], the approximating sum multiplies the approximate value of X when it is in 
the interval (x;_1,x;] by the probability that it will be in that interval and then sums 
over all the intervals. Clearly, as these intervals get smaller and smaller in length, we 
obtain the “expected value” of X. 

Stieltjes integrals are mainly of theoretical interest because they yield a compact 
way of defining and dealing with the properties of expectation. For instance, the use 
of Stieltjes integrals avoids the necessity of having to give separate statements and 
proofs of theorems for the continuous and the discrete cases. However, their prop- 
erties are very much the same as those of ordinary integrals, and all of the proofs 
presented in this chapter can easily be translated into proofs in the general case. 


SUMMARY 
If X and Y have a joint probability mass function p(x, y), then 


E[g(X,¥)] =) Yo ge. ypx.y) 
y Xx 
whereas if they have a joint density function f(x, y), then 


E[g(X, Y)] = il i g(x, y) f(x, y) dx dy 


A consequence of the preceding equations is that 


E[X + Y]=E[X] + E[y] 
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which generalizes to 
n n 
E| > >%|=)> > Ex 
i=1 i=1 


The covariance between random variables X and Y is given by 
Cov(X, Y) = E[(X — E[X](Y — E[Y]] = E[XY] — E[X]E[Y] 


A useful identity is 


Cov pa e oe y= » ba Cov(Xj, Yj) 
i=1 j=1 


i=1 j=1 


When vn = mand Y; = Xj,i = 1,...,n, the preceding formula gives 


Var WX = So Var(X) +25 °° CowX, ¥/) 
i=1 i=1 


i<j 
The correlation between X and Y, denoted by p(X, Y), is defined by 
Cov(x, Y) 
J Var(X)Var(Y) 


If X and Y are jointly discrete random variables, then the conditional expected value 
of X, given that Y = y, is defined by 


(X,Y) = 


EX\Y=ay)\= ) ari toa Sy] 


If X and Y are jointly continuous random variables, then 


E[X|Y =y]= i Eee 


where 


f(x,y) 
fy) 


is the conditional probability density of X given that Y = y. Conditional expecta- 
tions, which are similar to ordinary expectations except that all probabilities are now 
computed conditional on the event that Y = y, satisfy all the properties of ordinary 
expectations. 

Let E[X|Y] denote that function of Y whose value at Y = y is ELX|Y = y]. A very 
useful identity is 


fxiy@ly) = 


E|X] = E[E[X|¥]] 
In the case of discrete random variables, this equation reduces to the identity 


E[X)=)>_ AX|Y =y|P{Y = 5) 
y 


and, in the continuous case, to 


BX] = | ” ELXIY = ylfy) 
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The preceding equations can often be applied to obtain EX] by first “conditioning” 
on the value of some other random variable Y. In addition, since, for any event A, 
P(A) = E{Iy,], where J, is 1 if A occurs and is 0 otherwise, we can use the same 
equations to compute probabilities. 

The conditional variance of X, given that Y = y, is defined by 


Var(X|Y =y) = E[(X — E[X|Y =y)|¥ =y] 


Let Var(X|Y) be that function of Y whose value at Y = y is Var(X|Y = y). The 
following is known as the conditional variance formula: 


Var(X) = E[Var(X|Y)] + Var(ELX|Y]) 


Suppose that the random variable X is to be observed and, on the basis of its value, 
one must then predict the value of the random variable Y. In such a situation, it turns 
out that, among all predictors, E[Y|X] has the smallest expectation of the square of 
the difference between it and Y. 

The moment generating function of the random variable X is defined by 


M(t) = Efe] 


The moments of X can be obtained by successively differentiating M(t) and then 
evaluating the resulting quantity at t = 0. Specifically, we have 


E[x” = =1,2 
[ le (t) N= Ty 2s 
t=0 


Two useful results concerning moment generating functions are, first, that the 
moment generating function uniquely determines the distribution function of the 
random variable and, second, that the moment generating function of the sum of 
independent random variables is equal to the product of their moment generating 
functions. These results lead to simple proofs that the sum of independent normal 
(Poisson, gamma) random variables remains a normal (Poisson, gamma) random 
variable. 

If X1,...,Xm are all linear combinations of a finite set of independent standard 
normal random variables, then they are said to have a multivariate normal distri- 
bution. Their joint distribution is specified by the values of ELX;], Cov(Xj, Xj), i,j = 
jee 7 

If X1,...,X, are independent and identically distributed normal random variables, 
then their sample mean 


and their sample variance 


are independent. The sample mean_X is a normal random variable with mean jz and 
variance o7 /n; the random variable (n — 1)S? /o is a chi-squared random variable 
with n — 1 degrees of freedom. 


7.1. 


7.2. 


7.3. 


7.4. 


7.5. 


7.6. 


7.7. 


PROBLEMS 


A player throws a fair die and simultaneously 

flips a fair coin. If the coin lands heads, then she 

wins twice, and if tails, then one-half of the value 

that appears on the die. Determine her expected 

winnings. 

The game of Clue involves 6 suspects, 6 weapons, 

and 9 rooms. One of each is randomly chosen and 

the object of the game is to guess the chosen three. 

(a) How many solutions are possible? 
In one version of the game, the selection is 
made and then each of the players is randomly 
given three of the remaining cards. Let S, W, 
and R be, respectively, the numbers of sus- 
pects, weapons, and rooms in the set of three 
cards given to a specified player. Also, let X 
denote the number of solutions that are possi- 
ble after that player observes his or her three 
cards. 

(b) Express X in terms of S, W, and R. 

(c) Find ELX]. 

Gambles are independent, and each one results in 

the player being equally likely to win or lose 1 unit. 

Let W denote the net winnings of a gambler whose 

strategy is to stop gambling immediately after his 

first win. Find 

(a) P{W > 0} 

(b) P{W < 0} 

(c) E[W] 

If X and Y have joint density function 


1/y, 


fev») = | ifO<y<1,0<x<y 
TY) = 7 0. 


otherwise 


find 

(a) E[XY] 

(b) E[X] 

(c) E[Y] 

The county hospital is located at the center of a 
square whose sides are 3 miles wide. If an accident 
occurs within this square, then the hospital sends 
out an ambulance. The road network is rectangu- 
lar, so the travel distance from the hospital, whose 
coordinates are (0, 0), to the point (x, y) is |x| + |y|. 
If an accident occurs at a point that is uniformly 
distributed in the square, find the expected travel 
distance of the ambulance. 

A fair die is rolled 10 times. Calculate the expected 
sum of the 10 rolls. 

Suppose that A and B each randomly and indepen- 
dently choose 3 of 10 objects. Find the expected 
number of objects 

(a) chosen by both A and B; 

(b) not chosen by either A or B; 

(c) chosen by exactly one of A and B. 


7.8. 


7.9. 


7.10. 


7.11. 


7.12. 


7.13. 


7.14, 
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N people arrive separately to a professional din- 

ner. Upon arrival, each person looks to see if he 

or she has any friends among those present. That 

person then sits either at the table of a friend or 

at an unoccupied table if none of those present 

is a friend. Assuming that each of the - 

pairs of people is, independently, a pair of friends 

with probability p, find the expected number of 

occupied tables. 

Hint: Let X; equal 1 or 0, depending on whether 

the ith arrival sits at a previously unoccupied 

table. 

A total of balls, numbered 1 through v, are put 

into n urns, also numbered 1 through n in such a 

way that ball is equally likely to go into any of the 

urns 1,2,...,é. Find 

(a) the expected number of urns that are empty; 

(b) the probability that none of the urns is 
empty. 

Consider 3 trials, each having the same proba- 

bility of success. Let X denote the total num- 

ber of successes in these trials. If ELX] = 1.8, 

what is 

(a) the largest possible value of P(X = 3}? 

(b) the smallest possible value of P{X = 3}? 

In both cases, construct a probability scenario that 

results in P{X = 3} having the stated value. 

Hint: For part (b), you might start by letting U bea 

uniform random variable on (0, 1) and then defin- 

ing the trials in terms of the value of U. 

Consider n independent flips of a coin having 

probability p of landing on heads. Say that a 

changeover occurs whenever an outcome differs 

from the one preceding it. For instance, ifn = 

5 and the outcome is HHTHT, then there are 

3 changeovers. Find the expected number of 

changeovers. 

Hint: Express the number of changeovers as the 

sum of n — 1 Bernoulli random variables. 

A group of n men and n women is lined up at 

random. 

(a) Find the expected number of men who have a 
woman next to them. 

(b) Repeat part (a), but now assuming that the 
group is randomly seated at a round table. 

A set of 1000 cards numbered 1 through 1000 

is randomly distributed among 1000 people with 

each receiving one card. Compute the expected 

number of cards that are given to people whose 

age matches the number on the card. 

An urn has m black balls. At each stage, a black 

ball is removed and a new ball that is black with 
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probability p and white with probability 1 — p 
is put in its place. Find the expected number of 
stages needed until there are no more black balls 
in the urn. 

NOTE: The preceding has possible applications 
to understanding the AIDS disease. Part of the 
body’s immune system consists of a certain class 
of cells known as T-cells. There are 2 types of T- 
cells, called CD4 and CD8. Now, while the total 
number of T-cells in AIDS sufferers is (at least in 
the early stages of the disease) the same as that 
in healthy individuals, it has recently been dis- 
covered that the mix of CD4 and CD8 T-cells is 
different. Roughly 60 percent of the T-cells of a 
healthy person are of the CD4 type, whereas the 
percentage of the T-cells that are of CD4 type 
appears to decrease continually in AIDS sufferers. 
A recent model proposes that the HIV virus (the 
virus that causes AIDS) attacks CD4 cells and that 
the body’s mechanism for replacing killed T-cells 
does not differentiate between whether the killed 
T-cell was CD4 or CD8. Instead, it just produces 
a new T-cell that is CD4 with probability .6 and 
CD8 with probability .4. However, although this 
would seem to be a very efficient way of replac- 
ing killed T-cells when each one killed is equally 
likely to be any of the body’s T-cells (and thus has 
probability .6 of being CD4), it has dangerous con- 
sequences when facing a virus that targets only the 
CD4 T-cells. 


In Example 2h, say that i and j, i # j, form a 
matched pair if i chooses the hat belonging to j and 
j chooses the hat belonging to 7. Find the expected 
number of matched pairs. 


Let Z be a standard normal random variable, and, 
for a fixed x, set 
Z ifZ>x 
= f otherwise 
Show that ELX] = J ee [2 
JV 20 


A deck of n cards numbered 1 through n is thor- 
oughly shuffled so that all possible m! orderings can 
be assumed to be equally likely. Suppose you are 
to make n guesses sequentially, where the ith one 
is a guess of the card in position i. Let N denote 
the number of correct guesses. 

(a) If you are not given any information about 
your earlier guesses show that, for any strat- 
egy, E[N] = 1. 

(b) Suppose that after each guess you are shown 
the card that was in the position in question. 
What do you think is the best strategy? Show 
that, under this strategy, 


1 
n—-1 


asl 
~ | —dx =logn 
1 x 


(c) Suppose that you are told after each guess 
whether you are right or wrong. In this case, 
it can be shown that the strategy which maxi- 
mizes E[N] is one that keeps on guessing the 
same card until you are told you are correct 
and then changes to a new card. For this strat- 
egy, show that 


eel 


EIN] = ~ + 


Hint: For all parts, express N as the sum of indica- 
tor (that is, Bernoulli) random variables. 


. Cards from an ordinary deck of 52 playing cards 


are turned face up one at a time. If the Ist card 
is an ace, or the 2nd a deuce, or the 3rd a three, 
or..., or the 13th a king, or the 14 an ace, and so 
on, we say that a match occurs. Note that we do 
not require that the (13m + 1)th card be any par- 
ticular ace for a match to occur but only that it be 
an ace. Compute the expected number of matches 
that occur. 


. A certain region is inhabited by r distinct types of 


a certain species of insect. Each insect caught will, 
independently of the types of the previous catches, 
be of type i with probability 


: 
P,,i=1,...,r ys Rad 
1 


(a) Compute the mean number of insects that are 
caught before the first type 1 catch. 

(b) Compute the mean number of types of insects 
that are caught before the first type 1 catch. 


. In an urn containing n balls, the ith ball has weight 


W(i),i = 1,...,n. The balls are removed with- 
out replacement, one at a time, according to the 
following rule: At each selection, the probabil- 
ity that a given ball in the urn is chosen is equal 
to its weight divided by the sum of the weights 
remaining in the urn. For instance, if at some 
time i1,...,7, is the set of balls remaining in the 
urn, then the next selection will be i; with prob- 


‘ 
ability wii)/ Wi), j = 1,...,7r. Compute 
k=1 


the expected number of balls that are withdrawn 
before ball number 1 is removed. 


7.21. For a group of 100 people, compute 


(a) the expected number of days of the year that 
are birthdays of exactly 3 people: 
(b) the expected number of distinct birthdays. 


7.22. 


7.23. 


7.24, 


7.25. 


7.26. 


"7.27. 
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How many times would you expect to roll a fair die 
before all 6 sides appeared at least once? 

Urn 1 contains 5 white and 6 black balls, while urn 
2 contains 8 white and 10 black balls. Two balls 
are randomly selected from urn 1 and are put into 
urn 2. If 3 balls are then randomly selected from 
urn 2, compute the expected number of white balls 
in the trio. 

Hint: Let X; = 1 if the ith white ball initially in urn 
1 is one of the three selected, and let _X; = 0 other- 
wise. Similarly, let Y; = 1 if the ith white ball from 
urn 2 is one of the three selected, and let Y; = 0 
otherwise. The number of white balls in the trio 


can now be written as sx, + >} Y;. 
1 


1 

A bottle initially contains m large pills and n small 
pills. Each day, a patient randomly chooses one of 
the pills. If a small pill is chosen, then that pill is 
eaten. If a large pill is chosen, then the pill is bro- 
ken in two; one part is returned to the bottle (and 
is now considered a small pill) and the other part 
is then eaten. 

(a) Let X denote the number of small pills in the 
bottle after the last large pill has been chosen 
and its smaller half returned. Find EX]. 

Hint: Define n + m indicator variables, one for 

each of the small pills initially present and one 

for each of the m small pills created when a large 
one is split in two. Now use the argument of 

Example 2m. 

(b) Let Y denote the day on which the last large 
pill is chosen. Find E[Y]. 

Hint: What is the relationship between X and Y? 

Let X1,X2,... be a sequence of independent and 

identically distributed continuous random vari- 

ables. Let N = 2 be such that 


Xy =X) =: = Xn_1 < XN 


That is, N is the point at which the sequence stops 
decreasing. Show that E[N] = e. 

Hint: First find P{N = n}. 

If X,, X2,...,X» are independent and identically 
distributed random variables having uniform dis- 
tributions over (0, 1), find 

(a) E[max(X),...,Xn)]; 

(b) E[min(X,...,Xn)]. 

If 101 items are distributed among 10 boxes, then 
at least one of the boxes must contain more than 10 
items. Use the probabilistic method to prove this 
result. 

The k-of-r-out-of-n circular reliability system, k = 
r =n, consists of n components that are arranged in 
a circular fashion. Each component is either func- 
tional or failed, and the system functions if there 
is no block of r consecutive components of which 


*7.29. 


7.30. 


7.31. 


7.32. 


7.33. 


7.34, 
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at least k are failed. Show that there is no way 
to arrange 47 components, 8 of which are failed, 
to make a functional 3-of-12-out-of-47 circular 
system. 


There are 4 different types of coupons, the first 
2 of which compose one group and the second 2 
another group. Each new coupon obtained is type 7 
with probability pj, where pj = p2 = 1/8,p3 = 
p4 = 3/8. Find the expected number of coupons 
that one must obtain to have at least one of 

(a) all 4 types; 

(b) all the types of the first group; 

(c) all the types of the second group; 

(d) all the types of either group. 


If X and Y are independent and identically dis- 
tributed with mean pu and variance o”, find 


= 1] 


In Problem 6, calculate the variance of the sum of 
the rolls. 


In Problem 9, compute the variance of the number 
of empty urns. 

If ELX] = 1 and Var(X) = 5, find 

(a) E[2 + X)*]; 

(b) Var(4 + 3X). 

If 10 married couples are randomly seated at a 
round table, compute (a) the expected number and 
(b) the variance of the number of wives who are 
seated next to their husbands. 


Cards from an ordinary deck are turned face up 
one at a time. Compute the expected number of 
cards that need to be turned face up in order to 
obtain 

(a) 2 aces; 

(b) 5 spades; 

(c) all 13 hearts. 

Let X be the number of 1’s and Y the number 
of 2’s that occur in n rolls of a fair die. Compute 
Cov(X, Y). 

A die is rolled twice. Let X equal the sum of the 
outcomes, and let Y equal the first outcome minus 
the second. Compute Cov(X, Y). 


The random variables X and Y have a joint density 
function given by 


_ J2e/x Ox < 0,05 ysx 
IO = ( otherwise 


Compute Cov(X, Y). 
Let X,,...be independent with common mean pu 


and common variance o”, and set Y, = X, + 
Xnyi + Xn42- For j = 0, find Cov(Yn, Yn4j)- 


376 


7.40. 


7.41. 


7.42. 


7.43. 


7.44, 


Chapter 7 Properties of Expectation 


The joint density function of X and Y is given by 
1 
fy =-e OP, x >0,y>0 
y. 


Find E[X], E[Y], and show that Cov(X, Y) = 1. 

A pond contains 100 fish, of which 30 are carp. If 20 
fish are caught, what are the mean and variance of 
the number of carp among the 20? What assump- 
tions are you making? 

A group of 20 people consisting of 10 men and 
10 women is randomly arranged into 10 pairs of 
2 each. Compute the expectation and variance of 
the number of pairs that consist of a man and a 
woman. Now suppose the 20 people consist of 10 
married couples. Compute the mean and variance 
of the number of married couples that are paired 
together. 

Let X1,X2,...,X, be independent random vari- 
ables having an unknown continuous distribution 
function F, and let Y;, Y2,..., Ym be independent 
random variables having an unknown continuous 
distribution function G. Now order those n + m 
variables, and let 


1 if the ith smallest of then + m 
variables is from the X sample 
0 otherwise 


nt+m 


The random variable R = > il; is the sum of the 


i=1 
ranks of the X sample and is the basis of a standard 
statistical procedure (called the Wilcoxon sum-of- 
ranks test) for testing whether F and G are iden- 
tical distributions. This test accepts the hypothesis 
that F = G when R is neither too large nor too 
small. Assuming that the hypothesis of equality is 
in fact correct, compute the mean and variance 
of R. 
Hint: Use the results of Example 3e. 
Between two distinct methods for manufacturing 
certain goods, the quality of goods produced by 
method 7 is a continuous random variable having 
distribution F;,i = 1,2. Suppose that n goods are 
produced by method 1 and m by method 2. Rank 
the n + m goods according to quality, and let 


1 if the jth best was produced from 


Xj = method 1 

2 otherwise 
For the vector X1, X2,..., Xn4m, which consists of 
n 1’s and m 2’s, let R denote the number of runs 
of 1. For instance, ifn = 5,m = 2, and X = 


1,2,1,1,1,1,2, then R = 2. If F, = F> (that is, 
if the two methods produce identically distributed 
goods), what are the mean and variance of R? 


7.45. 


7.46. 
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7.48. 


7.49, 


7.50. 


7.51. 


7.52. 


If X1, Xo, X3, and X4 are (pairwise) uncorrelated 
random variables, each having mean 0 and vari- 
ance 1, compute the correlations of 

(a) X; + X2 and X27 + X3; 

(b) X; + Xz and X3 + X4. 

Consider the following dice game, as played at a 
certain gambling casino: Players 1 and 2 roll a pair 
of dice in turn. The bank then rolls the dice to 
determine the outcome according to the follow- 
ing rule: Player i,i = 1,2, wins if his roll is strictly 
greater than the bank’s. For i = 1,2, let 


— 1 ifiwins 
'“~]0 otherwise 


and show that J; and J, are positively correlated. 
Explain why this result was to be expected. 

Consider a graph having n vertices labeled 
1,2,...,, and suppose that, between each of the 


(3) pairs of distinct vertices, an edge is indepen- 


dently present with probability p. The degree of 

vertex i, designated as Dj, is the number of edges 

that have vertex i as one of their vertices. 

(a) What is the distribution of D;? 

(b) Find p(D;, Dj), the correlation between D; 
and Dj. 

A fair die is successively rolled. Let X and Y 

denote, respectively, the number of rolls necessary 

to obtain a 6 and a 5. Find 


(a) E[X]; 

(b) E[X|Y = 1); 

(c) ELX|Y =5]. 

There are two misshapen coins in a box; their 


probabilities for landing on heads when they are 
flipped are, respectively, .4 and .7. One of the coins 
is to be randomly chosen and flipped 10 times. 
Given that two of the first three flips landed on 
heads, what is the conditional expected number of 
heads in the 10 flips? 

The joint density of X and Y is given by 

en t/Ve-y 


f(x,y) = 


Compute E[X?|Y = y]. 
The joint density of X and Y is given by 


0O<x<mw, 0<y<w 


ey 


fy) =—; 
y 


Compute E[X°|Y = y]. 

A population is made up of r disjoint subgroups. 
Let p; denote the proportion of the population that 
is in subgroup j,i = 1,...,r. If the average weight 
of the members of subgroup i is w;,i = 1,...,7, 
what is the average weight of the members of the 
population? 


O<x<y, 0<y<ow 
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A prisoner is trapped in a cell containing 3 doors. 
The first door leads to a tunnel that returns him 
to his cell after 2 days’ travel. The second leads 
to a tunnel that returns him to his cell after 4 
days’ travel. The third door leads to freedom after 
1 day of travel. If it is assumed that the pris- 
oner will always select doors 1, 2, and 3 with 
respective probabilities .5, .3, and .2, what is the 
expected number of days until the prisoner reaches 
freedom? 
Consider the following dice game: A pair of dice 
is rolled. If the sum is 7, then the game ends and 
you win 0. If the sum is not 7, then you have the 
option of either stopping the game and receiv- 
ing an amount equal to that sum or starting over 
again. For each value of i,i = 2,...,12, find your 
expected return if you employ the strategy of stop- 
ping the first time that a value at least as large 
as i appears. What value of i leads to the largest 
expected return? 
Hint: Let X; denote the return when you use the 
critical value 7. To compute E[X;], condition on the 
initial sum. 
Ten hunters are waiting for ducks to fly by. When 
a flock of ducks flies overhead, the hunters fire at 
the same time, but each chooses his target at ran- 
dom, independently of the others. If each hunter 
independently hits his target with probability .6, 
compute the expected number of ducks that are 
hit. Assume that the number of ducks in a flock is 
a Poisson random variable with mean 6. 
The number of people who enter an elevator on 
the ground floor is a Poisson random variable with 
mean 10. If there are N floors above the ground 
floor, and if each person is equally likely to get off 
at any one of the N floors, independently of where 
the others get off, compute the expected number 
of stops that the elevator will make before dis- 
charging all of its passengers. 
Suppose that the expected number of accidents per 
week at an industrial plant is 5. Suppose also that 
the numbers of workers injured in each accident 
are independent random variables with a common 
mean of 2.5. If the number of workers injured in 
each accident is independent of the number of 
accidents that occur, compute the expected num- 
ber of workers injured in a week. 
A coin having probability p of coming up heads is 
continually flipped until both heads and tails have 
appeared. Find 
(a) the expected number of flips; 
(b) the probability that the last flip lands on 
heads. 
There are 1 + 1 participants in a game. Each 
person independently is a winner with probabil- 
ity p. The winners share a total prize of 1 unit. 
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(For instance, if 4 people win, then each of them 
receives is whereas if there are no winners, then 
none of the participants receive anything.) Let A 
denote a specified one of the players, and let X 
denote the amount that is received by A. 

(a) Compute the expected total prize shared by 


the players. 
1-(1- p yeti 
+1 
(c) Compute EX] by conditioning on whether A 
is a winner, and conclude that 


(b) Argue that ELX] = 


Lape 
(n + 1)p 


E[Q + B= 


when B is a binomial random variable with param- 
eters n and p. 


Each of m + 2 players pays 1 unit to a kitty in 

order to play the following game: A fair coin is to 

be flipped successively m times, where n is an odd 
number, and the successive outcomes are noted. 

Before the n flips, each player writes down a pre- 

diction of the outcomes. For instance, if n = 3, 

then a player might write down (H,H,T), which 

means that he or she predicts that the first flip 
will land on heads, the second on heads, and the 
third on tails. After the coins are flipped, the play- 
ers count their total number of correct predictions. 

Thus, if the actual outcomes are all heads, then the 

player who wrote (H, H, T) would have 2 correct 

predictions. The total kitty of m + 2 is then evenly 
split up among those players having the largest 
number of correct predictions. 

Since each of the coin flips is equally likely to 
land on either heads or tails, m of the players have 
decided to make their predictions in a totally ran- 
dom fashion. Specifically, they will each flip one 
of their own fair coins n times and then use the 
result as their prediction. However, the final 2 of 
the players have formed a syndicate and will use 
the following strategy: One of them will make pre- 
dictions in the same random fashion as the other 
m players, but the other one will then predict 
exactly the opposite of the first. That is, when the 
randomizing member of the syndicate predicts an 
H, the other member predicts a 7. For instance, 
if the randomizing member of the syndicate 
predicts (H, H, T), then the other one predicts (7, 
T, H). 

(a) Argue that exactly one of the syndicate mem- 
bers will have more than n/2 correct predic- 
tions. (Remember, n is odd.) 

(b) Let X denote the number of the m nonsyndi- 
cate players that have more than n/2 correct 
predictions. What is the distribution of X? 
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(c) With X as defined in part (b), argue that 
E[payoff to the syndicate] = (m + 2) 


XE : 
ben 


(d) Use part (c) of Problem 59 to conclude that 


2(m + 2) 
m+1 


fa] 


and explicitly compute this number when m = 
1,2, and 3. Because it can be shown that 


m+1 
2(m + 2) c (3) “ott 
m+ 1 2 
it follows that the syndicate’s strategy always 
gives it a positive expected profit. 

7.61. Let X;,... be independent random variables with 
the common distribution function F, and sup- 
pose they are independent of N, a geometric 
random variable with parameter p. Let M = 
max(X1,..., Xn). 

(a) Find P{M = x} by conditioning on N. 

(b) Find P{M S x|N = 1}. 

(c) Find P{(M S x|N > 1}. 

(d) Use (b) and (c) to rederive the probability you 
found in (a). 

7.62. Let U;, U2,... be a sequence of independent uni- 
form (0, 1) random variables. In Example 5i we 
showed that, for0 = x = 1, E[N(x)] = e*, where 


E[payoff to the syndicate] = 


n 
N(x) = min ney U; >x 
i=1 


This problem gives another approach to establish- 

ing that result. 

(a) Show by induction on 7 that, for0 < x = 1 
and alln = 0, 


n 


PING) =n + 1}= — 


Hint: First condition on U, and then use the 
induction hypothesis. 
Use part (a) to conclude that 


E[N(x)] = e&* 


7.63. An urn contains 30 balls, of which 10 are red and 
8 are blue. From this urn, 12 balls are randomly 
withdrawn. Let X denote the number of red and Y 
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the number of blue balls that are withdrawn. Find 

Cov(X, Y) 

(a) by defining appropriate indicator (that is, 
Bernoulli) random variables 


10 8 
X;, ¥; such that X¥ =) X,Y =} ¥; 
i=1 j=l 


(b) by conditioning (on either X or Y) to deter- 
mine E[XY]. 


. Type i light bulbs function for a random amount 


of time having mean jy; and standard deviation 
oj,i = 1,2. A light bulb randomly chosen from a 
bin of bulbs is a type 1 bulb with probability p and 
a type 2 bulb with probability 1 — p. Let X denote 
the lifetime of this bulb. Find 

(a) E[X]; 

(b) Varc(X). 

The number of winter storms in a good year is a 
Poisson random variable with mean 3, whereas the 
number in a bad year is a Poisson random variable 
with mean 5. If next year will be a good year with 
probability .4 or a bad year with probability .6, find 
the expected value and variance of the number of 
storms that will occur. 

In Example 5c, compute the variance of the length 
of time until the miner reaches safety. 

Consider a gambler who, at each gamble, either 
wins or loses her bet with respective probabilities p 
and 1 — p. A popular gambling system known 
as the Kelley strategy is to always bet the frac- 
tion 2p — 1 of your current fortune when p > 5. 
Compute the expected fortune after n gambles of 
a gambler who starts with x units and employs the 
Kelley strategy. 

The number of accidents that a person has in 
a given year is a Poisson random variable with 
mean A. However, suppose that the value of A 
changes from person to person, being equal to 2 
for 60 percent of the population and 3 for the other 
40 percent. If a person is chosen at random, what 
is the probability that he will have (a) 0 accidents 
and (b) exactly 3 accidents in a certain year? What 
is the conditional probability that he will have 3 
accidents in a given year, given that he had no acci- 
dents the preceding year? 

Repeat Problem 68 when the proportion of the 
population having a value of A less than x is equal 
tol — e™. 

Consider an urn containing a large number of 
coins, and suppose that each of the coins has some 
probability p of turning up heads when it is flipped. 
However, this value of p varies from coin to coin. 
Suppose that the composition of the urn is such 
that if a coin is selected at random from it, then 
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7.77 


the p-value of the coin can be regarded as being 
the value of a random variable that is uniformly 
distributed over [0, 1]. If a coin is selected at ran- 
dom from the urn and flipped twice, compute the 
probability that 

(a) the first flip results in a head; 

(b) both flips result in heads. 

In Problem 70, suppose that the coin is tossed n 
times. Let X denote the number of heads that 
occur. Show that 


ad ees | 


P=Or1. 2050 


Hint: Make use of the fact that 


1 
ete .. nba (a— DIG - D! 
[ x xX) dx = @ab- wD! 


when a and b are positive integers. 

Suppose that in Problem 70 we continue to flip the 
coin until a head appears. Let N denote the num- 
ber of flips needed. Find 

(a) P{N = i},i1 = 0; 


(b) P(N = i}; 
(c) E[N]. 
In Example 6b, let S denote the signal sent and R 


the signal received. 

(a) Compute E[R]. 

(b) Compute Var(R). 

(c) Is R normally distributed? 

(d) Compute Cov(R, S). 

In Example 6c, suppose that X is uniformly dis- 
tributed over (0, 1). If the discretized regions are 
determined by a9 = 0,a,; = 5, and az = 1, 
calculate the optimal quantizer Y and compute 
E[x = Y/). 

The moment generating function of X is given by 
Mx(t) = exp{2e’ — 2} and that of Y by My(t) = 
el 7 y. If X and Y are independent, what are 
(a) P{X + Y =2}? 

(b) P{XY = 0}? 

(c) ELXY]? 

Let X be the value of the first die and Y the sum of 
the values when two dice are rolled. Compute the 
joint moment generating function of X and Y. 
The joint density of X and Y is given by 


jes 
oot = 


2, 
ee ey /2. 


0O<y<a, 


—woO < xX < Ce 
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(a) Compute the joint moment generating func- 
tion of X and Y. 
(b) Compute the individual moment generating 
functions. 
Two envelopes, each containing a check, are 
placed in front of you. You are to choose one of 
the envelopes, open it, and see the amount of the 
check. At this point, either you can accept that 
amount or you can exchange it for the check in 
the unopened envelope. What should you do? Is it 
possible to devise a strategy that does better than 
just accepting the first envelope? 
Let A and B,A < B, denote the (unknown) 
amounts of the checks, and note that the strat- 
egy that randomly selects an envelope and always 
accepts its check has an expected return of 
(A + B)/2. Consider the following strategy: Let 
F(-) be any strictly increasing (that is, continu- 
ous) distribution function. Choose an envelope 
randomly and open it. If the discovered check has 
the value x, then accept it with probability F(x) and 
exchange it with probability 1 — F(x). 
(a) Show that if you employ the latter strategy, 
then your expected return is greater than 
(A + B)/2. 
Hint: Condition on whether the first envelope 
has the value A or B. 
Now consider the strategy that fixes a value x 
and then accepts the first check if its value is 
greater than x and exchanges it otherwise. 
Show that, for any x, the expected return 
under the x-strategy is always at least 
(A + B)/2 and that it is strictly larger than 
(A + B)/2 if x lies between A and B. 
Let X be a continuous random variable on the 
whole line, and consider the following strat- 
egy: Generate the value of X, and if X = x, 
then employ the x-strategy of part (b). Show 
that the expected return under this strategy is 
greater than (A + B)/2. 
Successive weekly sales, in units of one thousand 
dollars, have a bivariate normal distribution with 
common mean 40, common standard deviation 6, 
and correlation .6. 
(a) Find the probability that the total of the next 
2 weeks’ sales exceeds 90. 
(b) If the correlation were .2 rather than .6, do 
you think that this would increase or decrease 
the answer to (a)? Explain your reasoning. 
Repeat (a) when the correlation is .2. 


(b) 


(c) 
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THEORETICAL EXERCISES 


Show that E[(X — a)*] is minimized at a = E[X]. 
Suppose that X is a continuous random variable 
with density function f. Show that E[|X — al] is 
minimized when a is equal to the median of F. 
Hint: Write 


EX — al] = f be — atftay dy 


Now break up the integral into the regions where 
x < aand where x > a, and differentiate. 


Prove Proposition 2.1 when 

(a) X and Y have a joint probability mass func- 
tion; 

(b) X and Y have a joint probability density func- 
tion and g(x,y) = 0 for all x, y. 

Let X be a random variable having finite expec- 

tation 2 and variance o”, and let g(-) be a twice 

differentiable function. Show that 


§ i) 


Elg(X)] © g(u) + 5 


Hint: Expand g(-) in a Taylor series about yw. Use 
the first three terms and ignore the remainder. 


Let Aj, A2,...,A, be arbitrary events, and define 
Cy, = {at least k of the A; occur}. Show that 


Gy = > PA 
k=1 k=1 


Hint: Let X denote the number of the A; that 
occur. Show that both sides of the preceding equa- 
tion are equal to EX]. 


In the text, we noted that 


E|>°X%:| =>) 2X 
i=1 i=1 


when the Xj are all nonnegative random variables. 
Since an integral is a limit of sums, one might 
expect that 


E | [ xeoar| = [ E[X ()] dt 
0 0 


whenever X(t),0 = t < ov, are all nonnegative ran- 
dom variables; and this result is indeed true. Use it 
to give another proof of the result that, for a non- 
negative random variable X, 


E[X) =[ rx > tdt 
0 
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Hint: Define, for each nonnegative ft, the random 
variable X(t) by 


1 ift< xX 
xo={5 if =X 
Now relate {y° X (‘dt to X. 
We say that X is stochastically larger than Y, writ- 
ten X = Y, if, for all t. 


PIX >t} =P{Y >4 


Show that if ¥ = Y, then E[X] = E[Y] when 
(a) X and Y are nonnegative random variables; 
(b) X and ¥Y are arbitrary random variables. 
Hint: Write X as 


X=Xt — x7 
where 
x if x =0 : 0 if X=0 
ames — 
a =1; txag* = Ne if X <0 


Similarly, represent Y as Yt — Y~. Then make 
use of part (a). 
Show that X is stochastically larger than Y if and 
only if 

Elf(X)] = EIf)] 


for all increasing functions f. 

Hint: Show that X =z Y, then E[f(X)] = E[f(Y)] 
by showing that f(X) =s¢ f(Y) and then using The- 
oretical Exercise 7.7. To show that if E[f(X)] = 
E[f(Y)] for all increasing functions f, then P(X > 
t} = P{Y > 4, define an appropriate increasing 
function f. 

A coin having probability p of landing on heads 
is flipped n times. Compute the expected number 
of runs of heads of size 1, of size 2, and of size 
kKilsksn. 

Let X1, X2,...,X, be independent and identically 
distributed positive random variables. For k = n, 
find 


k 
2% 
i=1 

n 


> Xi 


f=1 


E 


Consider n independent trials, each resulting in 
any one of r possible outcomes with probabilities 
P,,P2,...,P,. Let X denote the number of out- 
comes that never occur in any of the trials. Find 
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*7.16. 
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E[X] and show that, among all probability vectors 


P,,...,P;, E[X] is minimized when P; = 1/r,i = 
fey ae 
Let X1,X2,... be a sequence of independent 


random variables having the probability mass 
function 


PG A= Fe 9 = 1p: 


n=1 


The random variable X = °°, X,/3” is said 
to have the Cantor distribution. Find E[X] and 
Var(X). 
Let X1,...,X, be independent and identically dis- 
tributed continuous random variables. We say that 
a record value occurs at time j,j =n, if X; = X; for 
alll =i = j. Show that 
n 
bal 
j=l 


n 
(b) Var(number of record values) = SG —1)/ iP. 
j=l 
For Example 2i, show that the variance of the 
number of coupons needed to amass a full set is 
equal to 


(a) E[number of record values] = 


N-1 


a= i? 

When JN is large, this can be shown to be 

approximately equal (in the sense that their ratio 

approaches 1 as N—->0o) to N??/6. 

Consider n independent trials, the ith of which 

results in a success with probability P;. 

(a) Compute the expected number of successes in 
the n trials—call it p. 

(b) For a fixed value of mu, what choice of 

P,,...,P, maximizes the variance of the num- 

ber of successes? 

(c) What choice minimizes the variance? 

Suppose that each of the elements of S = 

{1,2,...,m} is to be colored either red or blue. 

Show that if A,,...,A, are subsets of S, there 

is a way of doing the coloring so that at most 


y-(1/2)4iI-! of these subsets have all their ele- 
i=1 

ments the same color (where |A| denotes the num- 
ber of elements in the set A). 

Suppose that X; and X2 are independent random 
variables having a common mean jp. Suppose also 
that Var(X;) = oa? and Var(X>) = ae: The value 
of w is unknown, and it is proposed that pz be esti- 
mated by a weighted average of X; and X2. That 
is, AX; + (1 — A)X> will be used as an estimate 
of « for some appropriate value of 4. Which value 
of 4 yields the estimate having the lowest possible 
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variance? Explain why it is desirable to use this 
value of A. 

In Example 4f, we showed that the covariance 2 
the multinomial random variables N; and Nj; 1 

equal to —mP;P; by expressing N; and N; as ite 
sum of indicator variables. We could ae have 
obtained that result by using the formula 


Var(N; + Nj) = Var(N;i) + Var(Nj) + 2 Cov(Ni, Nj) 


(a) What is the distribution of N; + N;? 

(b) Use the preceding identity to show that 
Cov(Ni, Nj) = —mP;P;. 

Show that X and Y are identically distributed and 

not necessarily independent, then 


Cov(X¥ + Y,X — Y)=0 
The Conditional Covariance Formula. The con- 
ditional covariance of X and Y, given Z, is 
defined by 


Cov(X, Y|Z) = E[(X — E[X|Z)(Y — E[YIZ)1Z] 


(a) Show that 


Cov(X, Y|Z) = E[XY|Z] — E[X|ZJE[Y|Z] 


(b) Prove the conditional covariance formula 
Cov(X, Y) = E[Cov(x, Y|Z)] 
+ Cov(E[X|Z], E[Y|Z]) 


(c) Set X = Y in part (b) and obtain the condi- 
tional variance formula. 

Let X(,i = 1,...,n, denote the order statis- 

tics from a set of n uniform (0, 1) random vari- 

ables, and note that the density function of X(j) is 

given by 


n! 


i-1 
(-fie=s © 


x! O<x<1 


f@= 


(a) Compute Var(X(j)),i = 1,...,n. 
(b) Which value of i minimizes, and which value 
maximizes, Var(X(j))? 


Show that Y =a + bX, then 
_ f+ ifb>0 
p= ee ifb <0 


Show that Z is a standard normal random variable 
and if Y is defined by Y =a + bZ + cZ?, then 


b 


Vb2 + 22 


AY, Z)= 


382 
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Prove the Cauchy—Schwarz inequality, namely, 
(E[XY])* Ss E[X°]E[Y?] 


Hint: Unless Y = —tX for some constant, in which 
case the inequality holds with equality, if follows 
that, for all ¢, 


0 < E[(tX + Y)*] = E[X?]P? + 2E[XY]t + E[Y?] 
Hence, the roots of the quadratic equation 
E[X?]? + 2E[XY]t + E[Y?]=0 


must be imaginary, which implies that the discrim- 
inant of this quadratic equation must be negative. 
Show that if X and Y are independent, then 


E[X|Y = y] = E[X] for all y 

(a) in the discrete case; 

(b) in the continuous case. 

Prove that E[g(X)Y|X] = g(X)E[Y|X]. 

Prove that if E[Y|X = x] = E[Y] for all x, then X 
and Y are uncorrelated; give a counterexample to 
show that the converse is not true. 

Hint: Prove and use the fact that ELXY] = 
E[|XE[Y|X]]. 

Show that Cov(X, E[Y|X]) = Cov(x, Y). 

Let X1,...,X, be independent and identically dis- 
tributed random variables. Find 


E[X1|X41 +.---4 X, =x] 


Consider Example 4f, which is concerned with the 
multinomial distribution. Use conditional expec- 
tation to compute E[N;N;], and then use this to 
verify the formula for Cov(N;, N;) given in Exam- 
ple 4f. 

An urn initially contains b black and w white balls. 
At each stage, we add r black balls and then with- 
draw, at random, r balls from the b + w + r balls 
in the urn. Show that 


E|[number of white balls after stage f] 
Coa) 
= | ————__] w 
b+we+tr 
For an event A, let 74 equal 1 if A occurs and 


let it equal 0 if A does not occur. For a random 
variable X, show that 


E[XIa4] 
P(A) 


E[X|A] = 


A coin that lands on heads with probability p is 
continually flipped. Compute the expected num- 
ber of flips that are made until a string of r heads 
in a row is obtained. 
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Hint: Condition on the time of the first occurrence 
of tails to obtain the equation 


E[X] = (1 — p) op "G+ EX) 
i=1 


+1 — p) > ptr 


i=r+1 


Simplify and solve for ELX’]. 

For another approach to Theoretical Exercise 33, 
let 7; denote the number of flips required to obtain 
a run of r consecutive heads. 

(a) Determine E[T,|T,_1]- 

(b) Determine E[T,] in terms of E[7,_1]. 

(c) What is E[T;]? 

(d) What is E[7;,]? 

The probability generating function of the dis- 
crete nonnegative integer valued random variable 
X having probability mass function p;, j = 0, is 
defined by 


$(s) = E[s*] = Y° pjs! 
j=0 


Let Y be a geometric random variable with param- 
eter p= 1 — s,where 0 < s < 1. Suppose that Y 
is independent of X, and show that 


p(s) =P{X < Y} 


One ball at a time is randomly selected from an 
urn containing a white and b black balls until all of 
the remaining balls are of the same color. Let Map 
denote the expected number of balls left in the urn 
when the experiment ends. Compute a recursive 
formula for M,, and solve when a = 3 and b =5S. 

An urn contains a white and b black balls. After a 
ball is drawn, it is returned to the urn if it is white; 
but if it is black, it is replaced by a white ball from 
another urn. Let M,, denote the expected number 
of white balls in the urn after the foregoing opera- 
tion has been repeated n times. 

(a) Derive the recursive equation 


1 
Moss =(1- 5) Mn + 1 
(b) Use part (a) to prove that 
al n 
Mn = b — b{ 1 — —— 
—— ( ee 


(c) What is the probability that the (n + 1)st ball 
drawn is white? 
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The best linear predictor of Y with respect to Xj 
and X2 is equal toa + bX, + cX2, where a,b, and 
c are chosen to minimize 


EU(Y — @ + 6X + G57] 


Determine a, b, and c. 

The best quadratic predictor of Y with respect to 
Xisa+ bX + cX“, where a,b, and c are chosen to 
minimize E[(Y — (a + bX + cX*))*]. Determine 
a,b, and c. 

Use the conditional variance formula to determine 
the variance of a geometric random variable X 
having parameter p. 

Let X be a normal random variable with parame- 
ters 4 = Oando? = 1, and let /, independent of X, 


be such that P{J = 1} 5 P{I = 0}. Now define 
Y by 
X iff=1 
a | % if =0 


In words, Y is equally likely to equal either X 

or —X. 

(a) Are X and Y independent? 

(b) Are J and Y independent? 

(c) Show that Y is normal with mean 0 and vari- 
ance 1. 

(d) Show that Cov(X, Y) = 0. 

It follows from Proposition 6.1 and the fact that 

the best linear predictor of Y with respect to X is 

fy + p2(X — px) that if 


E[Y|X] =a + bX 


then 
Oy oO. 
a=fy — Pp—-Ux b=p— 
Ox Ox 


(Why?) Verify this directly. 
Show that, for random variables X and Z, 
EL X 


Y)?] = E[X?] — E[Y?] 


where 
Y=E[X|Z] 


Consider a population consisting of individuals 
able to produce offspring of the same kind. Sup- 
pose that, by the end of its lifetime, each individual 
will have produced j new offspring with probability 
P;, j = 0, independently of the number produced 
by any other individual. The number of individu- 
als initially present, denoted by X9, is called the 
size of the zeroth generation. All offspring of the 
zeroth generation constitute the first generation, 


7.45. 


7.46. 
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and their number is denoted by Xj. In general, 
let X, denote the size of the nth generation. Let 
w=) jP; and o* = \\(j — )?P; denote, respec- 
j=0 j=0 

tively, the mean and the variance of the number 
of offspring produced by a single individual. Sup- 
pose that Xp = 1— that is, initially there is a single 
individual in the population. 

(a) Show that 


E[Xn] = HE[Xn-1] 
(b) Use part (a) to conclude that 
E[Xn] = 2" 
(c) Show that 
Var(X,) = 07 n"! + pw? Var(Xy_1) 


(d) Use part (c) to conclude that 
nd 

ofr! (“= ) if #1 
Var(Xn) = w-l 


no 


ifu=1 
The model just described is known as a 
branching process, and an important ques- 
tion for a population that evolves along such 
lines is the probability that the population will 
eventually die out. Let z denote this proba- 
bility when the population starts with a single 
individual. That is, 


mz = P{population eventually dies out|Xp = 1) 


(e) Argue that z satisfies 


[o@) 
C= > Pr! 
j=0 


Hint: Condition on the number of offspring of 
the initial member of the population. 


Verify the formula for the moment generating 
function of a uniform random variable that is given 
in Table 7.7. Also, differentiate to verify the for- 
mulas for the mean and variance. 


For a standard normal random variable Z, let uy, = 
E[Z"]. Show that 
0 when n is odd 
Ln = ¥ (27)! 


— whenn = 2j 
2]! , 
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7.1. 


7.2. 


7.3. 


Properties of Expectation 


Hint: Start by expanding the moment generating 
function of Z into a Taylor series about 0 to obtain 


E[e’7] — fi 


Let X be a normal random variable with mean 
w and variance o”. Use the results of Theoretical 
Exercise 46 to show that 


n 2? aye 
(5) a toda 
zl 


[n/2] 


De 


j=0 


E[X") _ 


In the preceding equation, [7/2] is the largest inte- 
ger less than or equal to n/2. Check your answer by 
letting n = 1 andn=2. 

If Y = aX + b, where a and b are constants, 
express the moment generating function of Y in 
terms of the moment generating function of X. 
The positive random variable X is said to be a log- 
normal random variable with parameters ju and o” 
if log(X) is a normal random variable with mean 
wand variance o”. Use the normal moment gener- 
ating function to find the mean and variance of a 
lognormal random variable. 

Let X have moment generating function M(t), and 
define Y(t) = log M(t). Show that 


W"O|=0 = Var(X) 
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7.53. 


7.54. 


7.55. 


Use Table 7.2 to determine the distribution of 
>> Xi when X1,...,X, are independent and 
i=1 

identically distributed exponential random vari- 
ables, each having mean 1/2. 


Show how to compute Cov(X, Y) from the joint 
moment generating function of X and Y. 


Suppose that X1,...,X» have a multivariate nor- 
mal distribution. Show that X),...,X, are inde- 
pendent random variables if and only if 


Cov(Xj, Xj) =0 wheni # j 


If Z is a standard normal random variable, what is 
Cov(Z, Z”)? 

Suppose that Y is a normal random variable with 
mean yw and variance o”, and suppose also that the 
conditional distribution of X, given that Y = y, is 
normal with mean y and variance 1. 

(a) Argue that the joint distribution of X, Y is the 
same as that of Y + Z, Y when Z is a standard 
normal random variable that is independent 
of Y. 

Use the result of part (a) to argue that X,Y 
has a bivariate normal distribution. 

Find E[X], Var(X), and Corr(X, Y). 

Find E[Y|X = x]. 

What is the conditional distribution of Y given 
that X = x? 


(b) 


(c) 
(d) 
(e) 


SELF-TEST PROBLEMS AND EXERCISES 


Consider a list of m names, where the same name 

may appear more than once on the list. Let n(z), 

i = 1,...,m, denote the number of times that the 

name in position 7 appears on the list, and let d 

denote the number of distinct names on the list. 

(a) Express d in terms of the variables m, n(i),i = 
1,...,m. Let U be a uniform (0, 1) random 
variable, and let ¥ = [mU] + 1. 

(b) What is the probability mass function of X? 

(c) Argue that E[m/n(X)] = d. 

An urn has n white and m black balls that are 

removed one at a time in a randomly chosen order. 

Find the expected number of instances in which a 

white ball is immediately followed by a black one. 

Twenty individuals consisting of 10 married cou- 

ples are to be seated at 5 different tables, with 4 

people at each table. 

(a) Ifthe seating is done “at random,” what is the 
expected number of married couples that are 
seated at the same table? 

(b) If2 men and 2 women are randomly chosen to 
be seated at each table, what is the expected 


7.4. 


7.5. 


7.6. 


number of married couples that are seated at 
the same table? 
If a die is to be rolled until all sides have appeared 
at least once, find the expected number of times 
that outcome 1 appears. 
A deck of 2n cards consists of n red and n black 
cards. The cards are shuffled and then turned over 
one at a time. Suppose that each time a red card is 
turned over, we win 1 unit if more red cards than 
black cards have been turned over by that time. 
(For instance, if nm = 2 and the result is r br b, then 
we would win a total of 2 units.) Find the expected 
amount that we win. 
Let A,,A2,...,A, be events, and let N denote the 
number of them that occur. Also, let J = 1 if all of 
these events occur, and let it be 0 otherwise. Prove 
Bonferroni’s inequality, namely, 


P(A1-+-An) = D> P(A) — @— 1 
i=1 


Hint: Argue first that VN =n — 147. 
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7.8. 


*7.9, 


7.10. 


7.11. 


7.12. 


7.13. 


7.14. 


Let X be the smallest value obtained when k num- 
bers are randomly chosen from the set 1,...,z. 
Find ELX] by interpreting X as a negative hyper- 
geometric random variable. 

An arriving plane carries r families. A total of 
nj of these families have checked in a total of j 
pieces of luggage, )° nj = r. Suppose that when 


j 
the plane lands, the N = 7 jn; pieces of luggage 


come out of the plane in a fader order. As soon 
as a family collects all of its luggage, it immediately 
departs the airport. If the Sanchez family checked 
in j pieces of luggage, find the expected number of 
families that depart after they do. 

Nineteen items on the rim of a circle of radius 1 are 
to be chosen. Show that, for any choice of these 
points, there will be an arc of (arc) length 1 that 
contains at least 4 of them. 

Let X be a Poisson random variable with mean 4. 
Show that if A is not too small, then 


Var(VX) = .25 


Hint: Use the result of Theoretical Exercise 4 to 
approximate E[/X]. 
Suppose in Self-Test Problem 3 that the 20 peo- 
ple are to be seated at seven tables, three of which 
have 4 seats and four of which have 2 seats. If 
the people are randomly seated, find the expected 
value of the number of married couples that are 
seated at the same table. 

Individuals 1 through n,n > 1, are to be recruited 

into a firm in the following manner: Individual 1 

starts the firm and recruits individual 2. Individ- 

uals 1 and 2 will then compete to recruit indi- 
vidual 3. Once individual 3 is recruited, individu- 

als 1,2, and 3 will compete to recruit individual 4, 

and so on. Suppose that when individuals 1,2,...,7 

compete to recruit individual i + 1, each of them 

is equally likely to be the successful recruiter. 

(a) Find the expected number of the individuals 
1,...,2 who did not recruit anyone else. 

(b) Derive an expression for the variance of the 
number of individuals who did not recruit 
anyone else, and evaluate it for n = 5. 

The nine players on a basketball team consist of 2 

centers, 3 forwards, and 4 backcourt players. If the 

players are paired up at random into three groups 

of size 3 each, find (a) the expected value and (b) 

the variance of the number of triplets consisting of 

one of each type of player. 

A deck of 52 cards is shuffled and a bridge hand 

of 13 cards is dealt out. Let X and Y denote, 

respectively, the number of aces and the number 
of spades in the hand. 
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7.17. 


7.18. 
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(a) Show that X and Y are uncorrelated. 

(b) Are they independent? 

Each coin in a bin has a value attached to it. Each 
time that a coin with value p is flipped, it lands 
on heads with probability p. When a coin is ran- 
domly chosen from the bin, its value is uniformly 
distributed on (0, 1). Suppose that after the coin is 
chosen, but before it is flipped, you must predict 
whether it will land on heads or on tails. You will 
win 1 if you are correct and will lose 1 otherwise. 
(a) What is your expected gain if you are not told 
the value of the coin? 

Suppose now that you are allowed to inspect 
the coin before it is flipped, with the result of 
your inspection being that you learn the value 
of the coin. As a function of p, the value of the 
coin, what prediction should you make? 
Under the conditions of part (b), what is your 
expected gain? 

In Self-Test Problem 1, we showed how to use 
the value of a uniform (0, 1) random variable 
(commonly called a random number) to obtain the 
value of a random variable whose mean is equal 
to the expected number of distinct names on a list. 
However, its use required that one choose a ran- 
dom position and then determine the number of 
times that the name in that position appears on 
the list. Another approach, which can be more effi- 
cient when there is a large amount of replication of 
names, is as follows: As before, start by choosing 
the random variable X as in Problem 1. Now iden- 
tify the name in position X, and then go through 
the list, starting at the beginning, until that name 
appears. Let J equal 0 if you encounter that name 
before getting to position X, and let J equal 1 if 
your first encounter with the name is at position X. 
Show that E[mI] = d. 

Hint: Compute E[/] by using conditional expecta- 
tion. 

A total of m items are to be sequentially dis- 
tributed among n cells, with each item indepen- 
dently being put in cell j with probability pj, 7 = 
1,...,n. Find the expected number of collisions 
that occur, where a collision occurs whenever an 
item is put into a nonempty cell. 

Let X be the length of the initial run in a random 
ordering of n ones and m zeroes. That is, if the first 
k values are the same (either all ones or all zeroes), 
then X = k. Find E[X]. 

There are n items in a box labeled H and m ina 
box labeled T. A coin that comes up heads with 
probability p and tails with probability 1 — p is 
flipped. Each time it comes up heads, an item is 
removed from the H box, and each time it comes 
up tails, an item is removed from the T box. (If a 
box is empty and its outcome occurs, then no items 


(b) 


(c) 
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are removed.) Find the expected number of coin 
flips needed for both boxes to become empty. 
Hint: Condition on the number of heads in the first 
n + m flips. 

Let X be a nonnegative random variable having 
distribution function F. Show that if F(x) = 1 — 
F(x), then 


CO 
E[x"] =f x" TF (x) dx 
0 
Hint: Start with the identity 
x 
X"=n [ x"! dx 
0 


=n x" Ty (x) dx 
0 


where 
1, ifx < X 
E:(x) = Fe otherwise 
Let a,...,d,, not all equal to0, be such that 
>, 4; = 0. Show that there is a permutation 
ij,...,% such that ae Gidi,,, < 0. 


Hint: Use the probabilistic method. (It is interest- 

ing that there need not be a permutation whose 

sum of products of successive pairs is positive. For 

instance, ifn = 3, aj = ag = —1, and a3 = 2, there 

is no such permutation.) 

Suppose that X;, i = 1,2,3, are independent Pois- 

son random variables with respective means ij, 

i= 1,2,3. Let X = X, + X2, and Y = X2 + X3. 

The random vector_X, Y is said to have a bivariate 

Poisson distribution. 

(a) Find ELX] and E[Y]. 

(b) Find Cov(X, Y). 

(c) Find the joint probability mass function 
P(X =1,Y = j}. 

Let (Xj, Yj), i = 1,..., be a sequence of indepen- 

dent and identically distributed random vectors. 

That is, X;, Y; is independent of, and has the same 

distribution as X2, Y2, and so on. Although Xj; and 

Y; can be dependent, X; and Y; are independent 

when i # j. Let 


by = E[Xi], wy = E[Yi], 02 = Var(X), 
oP = Var(Yj), p = Corr(X;, Yj) 


Find Corr()j21 Xi, ja1 Yj). 

Three cards are randomly chosen without replace- 
ment from an ordinary deck of 52 cards. Let X 
denote the number of aces chosen. 

(a) Find E[X|the ace of spades is chosen]. 

(b) Find E[X|at least one ace is chosen]. 
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Let ® be the standard normal distribution func- 
tion, and let XY be a normal random variable with 
mean py and variance 1. We want to find E[®(X)]. 
To do so, let Z be a standard normal random vari- 
able that is independent of X, and let 


(a) Show that E[/|X = x] = ®(). 
(b) Show that E[®(X)] = P{Z < X}. 
(c) Show that E[®(X)] = (7). 

Hint: What is the distribution of X — Z? 
The preceding comes up in statistics. Suppose 
you are about to observe the value of a random 
variable X that is normally distributed with an 
unknown mean y and variance 1, and suppose that 
you want to test the hypothesis that the mean wu 
is greater than or equal to 0. Clearly you would 
want to reject this hypothesis if X is sufficiently 
small. If it results that X¥ = x, then the p-value 
of the hypothesis that the mean is greater than 
or equal to 0 is defined to be the probability that 
X would be as small as x if ~% were equal to 0 
(its smallest possible value if the hypothesis were 
true). (A small p-value is taken as an indication 
that the hypothesis is probably false.) Because X 
has a standard normal distribution when yu = 0, 
the p-value that results when X = x is ®(x). 
Therefore, the preceding shows that the expected 
p-value that results when the true mean is pu 
is D( 7): 

A coin that comes up heads with probability p 
is flipped until either a total of m heads or of 
m tails is amassed. Find the expected number of 
flips. 

Hint: Imagine that one continues to flip even after 
the goal is attained. Let X denote the number of 
flips needed to obtain n heads, and let Y denote 
the number of flips needed to obtain m tails. Note 
that max(XY,Y) + min(Y,Y) = X + Y. Com- 
pute E[max(X, Y)] by conditioning on the number 
of heads in the first n + m — 1 flips. 

A deck of n cards numbered / through 1, initially 
in any arbitrary order, is shuffled in the following 
manner: At each stage, we randomly choose one 
of the cards and move it to the front of the deck, 
leaving the relative positions of the other cards 
unchanged. This procedure is continued until all 
but one of the cards has been chosen. At this point 
it follows by symmetry that all nm! possible order- 
ings are equally likely. Find the expected number 
of stages that are required. 

Suppose that a sequence of independent trials in 
which each trial is a success with probability p is 


performed until either a success occurs or a total of 
n trials has been reached. Find the mean number 
of trials that are performed. 

Hint: The computations are simplified if you use 
the identity that, for a nonnegative integer valued 
random variable X, 


E[X] =) P(x = i} 
i=1 
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Suppose that X and Y are both Bernoulli random 
variables. Show that X and Y are independent if 
and only if Cov(X, Y) = 0. 

In the generalized match problem, there are n 
individuals of whom nj; wear hat size i, )“y_, ni = 
n. There are also n hats, of which h; are of 
size i, )“i_,hj = n. If each individual randomly 
chooses a hat (without replacement), find the 
expected number who choose a hat that is their 
size. 
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INTRODUCTION 

CHEBYSHEV’S INEQUALITY AND THE WEAK LAW OF LARGE NUMBERS 

THE CENTRAL LIMIT THEOREM 

THE STRONG LAW OF LARGE NUMBERS 

OTHER INEQUALITIES 

BOUNDING THE ERROR PROBABILITY WHEN APPROXIMATING A SUM OF INDEPENDENT BERNOULLI 
RANDOM VARIABLES BY A POISSON RANDOM VARIABLE 


INTRODUCTION 


The most important theoretical results in probability theory are limit theorems. Of 
these, the most important are those classified either under the heading laws of large 
numbers or under the heading central limit theorems. Usually, theorems are consid- 
ered to be laws of large numbers if they are concerned with stating conditions under 
which the average of a sequence of random variables converges (in some sense) to 
the expected average. By contrast, central limit theorems are concerned with deter- 
mining conditions under which the sum of a large number of random variables has a 
probability distribution that is approximately normal. 


CHEBYSHEV'S INEQUALITY AND THE WEAK LAW OF LARGE NUMBERS 


We start this section by proving a result known as Markov’s inequality. 


Proposition 2.1. Markov’s inequality 
If X is a random variable that takes only nonnegative values, then, for any value 
a> 0, 
E|X] 
P(X = a} = — 
Proof. Fora > 0, let 


a 1 wx =a 
~ 10 otherwise 


and note that, since X = 0, 


xX 
I< — 
a 


Taking expectations of the preceding inequality yields 


which, because E[J] = P{X = a}, proves the result. 


As a corollary, we obtain Proposition 2.2. 
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Proposition 2.2. Chebyshev’s inequality 
If X is a random variable with finite mean py and variance o”, then, for any value 


k > 0, 
o2 
PX — pl =k} = a 


Proof. Since (X — 1)? is a nonnegative random variable, we can apply Markov’s 
inequality (with a = k”) to obtain 


EU(X — p)?] 


P(X - pY 2h} s = 


(2.1) 


But since (¥ — y)? = k’ if and only if |X — yu| = k, Equation (2.1) is equivalent to 


E[(X — yp)? ; 
PUX — pl=Q= K = aes 


and the proof is complete. 


The importance of Markov’s and Chebyshev’s inequalities is that they enable us to 
derive bounds on probabilities when only the mean, or both the mean and the vari- 
ance, of the probability distribution are known. Of course, if the actual distribution 
were known, then the desired probabilities could be computed exactly and we would 
not need to resort to bounds. 


EXAMPLE 2a 


Suppose that it is known that the number of items produced in a factory during a 
week is a random variable with mean 50. 


(a) What can be said about the probability that this week’s production will 
exceed 75? 


(b) If the variance of a week’s production is known to equal 25, then what can 
be said about the probability that this week’s production will be between 40 
and 60? 


Solution. Let X be the number of items that will be produced in a week. 


(a) By Markov’s inequality, 


PLX 75) < FIX) 50 2 
= = Oe = CO 
75 75 3 
(b) By Chebyshev’s inequality, 

o? 1 

P{\X — 50| = 10} s —,=- 

( |= 10) = 5=5 

Hence, 

1 3 


PX — 50| < 103} =>1—-7=- 
{| | < 10} 4 


so the probability that this week’s production will be between 40 and 60 is at 
least .75. | 
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As Chebyshev’s inequality is valid for all distributions of the random variable X, 
we cannot expect the bound on the probability to be very close to the actual proba- 
bility in most cases. For instance, consider Example 2b. 


EXAMPLE 2b 


If X is uniformly distributed over the interval (0, 10), then, since E[X] = 5 and 
Var(X) = 23, it follows from Chebyshev’s inequality that 


25 


PIX — 5| > 4s 75 


22 


whereas the exact result is 
P{|\X — 5| > 44 =.20 


Thus, although Chebyshev’s inequality is correct, the upper bound that it provides is 
not particularly close to the actual probability. 

Similarly, if X is a normal random variable with mean jw and variance ae 
Chebyshev’s inequality states that 


1 
P{\X — p| > 20} S ri 
whereas the actual probability is given by 
X — p 
P{|X -— p| > 20} =P > 2} =2[1 — &(2)] ~ .0456 | 


Chebyshev’s inequality is often used as a theoretical tool in proving results. This 
use is illustrated first by Proposition 2.3 and then, most importantly, by the weak law 
of large numbers. 


Proposition 2.3. If Var(X) = 0, then 
P{X = E[X]}=1 


In other words, the only random variables having variances equal to 0 are those which 
are constant with probability 1. 


Proof. By Chebyshev’s inequality, we have, for anyn = 1, 
1 
Py|X — p| > -¢ =0 
n 
Letting noo and using the continuity property of probability yields 


: 1 1 
O= lim PYIX ~ al > =| = Pim 1a Sule i} 


and the result is established. 
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Theorem 2.1 The weak law of large numbers 
Let X1, X2,...be a sequence of independent and identically distributed random vari- 
ables, each having finite mean E|X;| = . Then, for any « > 0, 


oe: 
n 


H > | >0 as n->o 
Proof. We shall prove the theorem only under the additional assumption that the 
random variables have a finite variance o?. Now, since 


7 Mat tn) 
n 


|=« and Var ( 


nN n 


it follows from Chebyshev’s inequality that 


2 


n 


and the result is proven. 


The weak law of large numbers was originally proven by James Bernoulli for the 
special case where the X; are 0, 1 (that is, Bernoulli) random variables. His statement 
and proof of this theorem were presented in his book Ars Conjectandi, which was 
published in 1713, eight years after his death, by his nephew Nicholas Bernoulli. Note 
that, because Chebyshev’s inequality was not known in Bernoulli’s time, Bernoulli 
had to resort to a quite ingenious proof to establish the result. The general form of 
the weak law of large numbers presented in Theorem 2.1 was proved by the Russian 
mathematician Khintchine. 


8.3. THE CENTRAL LIMIT THEOREM 


The central limit theorem is one of the most remarkable results in probability theory. 
Loosely put, it states that the sum of a large number of independent random variables 
has a distribution that is approximately normal. Hence, it not only provides a simple 
method for computing approximate probabilities for sums of independent random 
variables, but also helps explain the remarkable fact that the empirical frequencies of 
so many natural populations exhibit bell-shaped (that is, normal) curves. 

In its simplest form the central limit theorem is as follows. 


Theorem 3.1 The central limit theorem 
Let X1, X2,...be a sequence of independent and identically distributed random vari- 
ables, each having mean wand variance o7. Then the distribution of 


Xi tt: + X, -— ne 
a/n 


tends to the standard normal as n->co. That is, for —co < a < ©, 


xX. +t Xn 1 a 
P uke me i al at—> / e-* 2 dx as n—>00 
o/n V2 Joo 


The key to the proof of the central limit theorem is the following lemma, which we 
state without proof. 
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Lemma 3.1 


Let Z1, Z2,... be a sequence of random variables having distribution functions Fz,, 
and moment generating functions Mz,,n = 1; and let Z be a random variable 
having distribution function Fz and moment generating function Mz. If Mz, (t) > 
Mz(0) for allt, then Fz, (1) > Fz(f for all t at which F'7(4) is continuous. 


If we let Z be a standard normal random variable, then, since Mz(t) = ef / 2 it 
follows from Lemma 3.1 that if Mz, (t) > ef asn—> oo, then Fz, (t) > ®(t) asin — oo. 
We are now ready to prove the central limit theorem. 


Proof of the Central Limit Theorem: Let us assume at first that 1 = 0 and o? = 1. 
We shall prove the theorem under the assumption that the moment generating func- 
tion of the X;, M(d), exists and is finite. Now, the moment generating function of 


X;i/./n is given by 
tX; _ t 
elo a} |) 


n n 
Thus, the moment generating function of }~ X;/,/n is given by [au (5) | . Let 


i=l - 
L(t) = log M(t) 
and note that 
L(O) =0 
M'(0) 
M(0) 
=U 
=0 
M(0)M"(0) — [M'(O)P 
[M(0)}? 


L'(0) = 


LY (0) = 


= E[X?] 
=1 
Now, to prove the theorem, we must show that [M(t/,/n)]" > ef /2 as n— oo, OF, 


equivalently, that nL(t/,/n) > t?/2 as n> oo. To show this, note that 
L(t/./n) a, =a rr 
——— = lim 


im 7 im =) by L’H6pital’s rule 
if 
= lim | L/int 
n— oo 2n-1/2 
_L"(t —3/2 72 
= a ; nie again by L’H6pital’s rule 
n—> oo —2n- 
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Thus, the central limit theorem is proven when w = 0 and o? = 1. The result 
now follows in the general case by considering the standardized random variables 
X} = (Xi — p)/o and applying the preceding result, since ELX;'] = 0, Var(X;) = 1. 


Remark. Although Theorem 3.1 states only that, for each a, 


a 
pa ee eh Oe 


o/n 


it can, in fact, be shown that the convergence is uniform in a. [We say that f,(a) > f(a) 
uniformly in a if, for each e > 0, there exists an N such that |f;,(a) — f(a)| < ¢ for all 
a whenever n = N.] 


The first version of the central limit theorem was proven by DeMoivre around 
1733 for the special case where the X; are Bernoulli random variables with p = . 
The theorem was subsequently extended by Laplace to the case of arbitrary p. (Since 
a binomial random variable may be regarded as the sum of n independent and identi- 
cally distributed Bernoulli random variables, this justifies the normal approximation 
to the binomial that was presented in Section 5.4.1.) Laplace also discovered the more 
general form of the central limit theorem given in Theorem 3.1. His proof, however, 
was not completely rigorous and, in fact, cannot easily be made rigorous. A truly 
rigorous proof of the central limit theorem was first presented by the Russian mathe- 
matician Liapounoff in the period 1901-1902. 

This important theorem is illustrated by the central limit theorem module on the 
text website. This website yields plots of the density function of the sum of n inde- 
pendent and identically distributed random variables that each take on one of the 
values 0, 1, 2, 3,4. When using it, one enters the probability mass function and the 
desired value of n. Figure 8.1 shows the resulting plots for a specified probability mass 
function when (a) n = 5, (b) m = 10, (c) m = 25, and (d) n = 100. 


EXAMPLE 3a 


An astronomer is interested in measuring the distance, in light-years, from his obser- 
vatory to a distant star. Although the astronomer has a measuring technique, he 
knows that, because of changing atmospheric conditions and normal error, each time 
a measurement is made it will not yield the exact distance, but merely an estimate. 
As a result, the astronomer plans to make a series of measurements and then use the 
average value of these measurements as his estimated value of the actual distance. 
If the astronomer believes that the values of the measurements are independent and 
identically distributed random variables having a common mean d (the actual dis- 
tance) and a common variance of 4 (light-years), how many measurements need he 
make to be reasonably sure that his estimated distance is accurate to within +.5 light- 
year? 


Solution. Suppose that the astronomer decides to make n observations. If X41, 
X2,...,Xy, are the nm measurements, then, from the central limit theorem, it 
follows that 


WX — nd 
i=1 


a 
7 2/n 
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Enter the probabilities and the number of random 
variables to be summed. The output gives the mass 
function of the sum along with its mean and 
variance. 
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Mean = 10.75 
Variance = 12.6375 


FIGURE 8.1(a) 
has approximately a standard normal distribution. Hence, 


n 
yx 
= i=1 


is Ss 


02) -1 


Therefore, if the astronomer wants, for instance, to be 95 percent certain that his 
estimated value is accurate to within .5 light year, he should make n* measurements, 
where n* is such that 


2® (=) — 1=.95 or (=) = .975 


Thus, from Table 5.1 of Chapter 5, 
J/n* 
4 


=196 or  n*=(7.84)* © 61.47 


As n* is not integral valued, he should make 62 observations. 
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Enter the probabilities and the number of random 
variables to be summed. The output gives the mass 
function of the sum along with its mean and 
variance. 
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FIGURE 8.1(b) 


Note, however, that the preceding analysis has been done under the assumption 
that the normal approximation will be a good approximation when n = 62. Although 
this will usually be the case, in general the question of how large n need be before 
the approximation is “good” depends on the distribution of the Xj. If the astronomer 
is concerned about this point and wants to take no chances, he can still solve his 
problem by using Chebyshev’s inequality. Since 


n n 
Xj Xj 4 
E — = — S-—. 
y%)aa var(y*)=4 
i=1 i=l 
Chebyshev’s inequality yields 
— Xj 4 16 


Hence, if he makes n = 16/.05 = 320 observations, he can be 95 percent certain that 
his estimate will be accurate to within .5 light-year. | 
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EXAMPLE 3b 


The number of students who enroll in a psychology course is a Poisson random vari- 
able with mean 100. The professor in charge of the course has decided that if the 
number enrolling is 120 or more, he will teach the course in two separate sections, 
whereas if fewer than 120 students enroll, he will teach all of the students together 
in a single section. What is the probability that the professor will have to teach two 
sections? 


Solution. The exact solution 
a ; 
a De il 
i=120 


does not readily yield a numerical answer. However, by recalling that a Poisson ran- 
dom variable with mean 100 is the sum of 100 independent Poisson random variables, 
each with mean 1, we can make use of the central limit theorem to obtain an approx- 
imate solution. If X denotes the number of students that enroll in the course, we 
have 


P{X = 120} = P{X = 119.5} (the continuity correction) 
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variance. 
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X — 100 _ 119.5 — 100 
v100  ~=—- 100 
1 — (1.95) 


0256 


where we have used the fact that the variance of a Poisson random variable is equal 


to its mean. 


EXAMPLE 3c 


If 10 fair dice are rolled, find the approximate probability that the sum obtained is 
between 30 and 40, inclusive. 


Solution. Let X; denote the value of the ith die, i= 1,2,...,10. Since 


E(X) = . Var(X;) = E[X2] — (ELXi)) 


2_ 35 
12: 


398 Chapter 8 


Limit Theorems 


the central limit theorem yields 


295 —35  X — 35 _ 40.5 — 35 
= = 


350 fo 7 350 

a: we We. 
2@(1.0184) — 1 

= .692 a 


P(29.5 < X < 405}=P 


2 


EXAMPLE 3d 


Let Xj,i = 1,...,10, be independent random variables, each uniformly distributed 


10 
over (0, 1). Calculate an approximation to P { 5) X; > 6+. 
i=l 


Solution. Since E[X;] = 5 and Var(X;) = b we have, by the central limit theorem, 


10 
\- Xi — 5 


10 6-5 
P\)°X; > 6} = Pt — > 
fis) 104) 
12 12 
= 1 -— (v1.2) 
=~ .1367 
10 
Hence, )> X; will be greater than 6 only 14 percent of the time. | 


i=1 
EXAMPLE 3e 


An instructor has 50 exams that will be graded in sequence. The times required to 
grade the 50 exams are independent, with a common distribution that has mean 
20 minutes and standard deviation 4 minutes. Approximate the probability that the 
instructor will grade at least 25 of the exams in the first 450 minutes of work. 


Solution. If we let X; be the time that it takes to grade exam i, then 


25 
xe 2 Ke 
i=1 


is the time it takes to grade the first 25 exams. Because the instructor will grade at 
least 25 exams in the first 450 minutes of work if the time it takes to grade the first 25 
exams is less than or equal to 450, we see that the desired probability is P{X = 450}. 
To approximate this probability, we use the central limit theorem. Now, 


25 
E[X] = )/ E[X;] = 25(20) = 500 
i=1 


and 
25 


Var(X) = a Var(X;) = 25(16) = 400 
i=l 
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Consequently, with Z being a standard normal random variable, we have 


X — 500 — 450 — 500 
P{X < 450} = P{ z 


J/400  @~=—- 400 
~ P{Z < —2.5} 
2PiZ = 25) 


=1 — 6(2.5) = .006 a 


Central limit theorems also exist when the Xj; are independent, but not necessarily 
identically distributed random variables. One version, by no means the most general, 
is as follows. 

Theorem 3.2 Central limit theorem for independent random variables 

Let X1,X2,... be a sequence of independent random variables having respective 

means and variances 1; = E|X;j] o2 = Var(Xj). If (a) the X; are uniformly 


ae 


CO 
bounded—that is, if for some M, P{|Xj\ < M}=1 for alli, and (b) > o? =co—then 


i=1 
So(% = Mi) 


r= <a‘—>®(a) as n>o 


n 
2 
2 oF 
i=1 


Historical Note 


Pierre-Simon, Marquis de Laplace 

The central limit theorem was originally stated and proven by the French math- 
ematician Pierre-Simon, Marquis de Laplace, who came to the theorem from his 
observations that errors of measurement (which can usually be regarded as being 
the sum of a large number of tiny forces) tend to be normally distributed. Laplace, 
who was also a famous astronomer (and indeed was called “the Newton of France”), 
was one of the great early contributors to both probability and statistics. Laplace 
was also a popularizer of the uses of probability in everyday life. He strongly believed| 
in its importance, as is indicated by the following quotations of his taken from his 
published book Analytical Theory of Probability: “We see that the theory of proba- 
bility is at bottom only common sense reduced to calculation; it makes us appreciate 
with exactitude what reasonable minds feel by a sort of instinct, often without being 
able to account for it.... It is remarkable that this science, which originated in the 
consideration of games of chance, should become the most important object of 
human knowledge.... The most important questions of life are, for the most part, 
really only problems of probability.” 

The application of the central limit theorem to show that measurement errors 
are approximately normally distributed is regarded as an important contribution to 
science. Indeed, in the 17th and 18th centuries the central limit theorem was often 
called the law of frequency of errors. Listen to the words of Francis Galton (taken 
from his book Natural Inheritance, published in 1889): “I know of scarcely anything 
so apt to impress the imagination as the wonderful form of cosmic order expressed 
by the ‘Law of Frequency of Error.’ The Law would have been personified by the 
Greeks and deified, if they had known of it. It reigns with serenity and in complete 
self-effacement amidst the wildest confusion. The huger the mob and the greater the 
apparent anarchy, the more perfect is its sway. It is the supreme law of unreason.” 


400 


8.4 
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THE STRONG LAW OF LARGE NUMBERS 


The strong law of large numbers is probably the best-known result in probability the- 
ory. It states that the average of a sequence of independent random variables having 
a common distribution will, with probability 1, converge to the mean of that distribu- 
tion. 


Theorem 4.1 The strong law of large numbers 
Let X1, X2,...be a sequence of independent and identically distributed random vari- 
ables, each having a finite mean 1 = E[Xj]. Then, with probability 1, 


XX + Xp +--+ XM, r 
> as n—-oo 


n 

As an application of the strong law of large numbers, suppose that a sequence of 
independent trials of some experiment is performed. Let EF be a fixed event of the 
experiment, and denote by P(£) the probability that F occurs on any particular trial. 
Letting 


Y= 1 if EF occurs on the ith trial 
'“~ )0 if E does not occur on the ith trial 


we have, by the strong law of large numbers, that with probability 1, 


KG Bsa eM 
nN 


> E[X] = P(E) (4.1) 


Since X; + --- + X;, represents the number of times that the event E occurs in the 
first n trials, we may interpret Equation (4.1) as stating that, with probability 1, the 
limiting proportion of time that the event E occurs is just P(E). 

Although the theorem can be proven without this assumption, our proof of the 
strong law of large numbers will assume that the random variables X; have a finite 
fourth moment. That is, we will suppose that E [x} [=k = oe 


Proof of the Strong Law of Large Numbers: To begin, assume that jz, the mean of 
n 


the Xj, is equal to 0. Let S$, = >> X; and consider 
i=l 


AS |= 21 feet RO be G5 
My bee ey ace OO] 


Expanding the right side of the preceding equation results in terms of the form 


4 
X;', 


XPX), XPX}, XPXjXe, amd Xi XjX,X, 


where i, j, k, and / are all different. Because all the X; have mean 0, it follows by 
independence that 
E[X} Xj] = ELX?]ELXj] = 0 
E[X?X;X;] = E[X/JE[XJE[Xx] = 0 
E[X;X;X;X1] = 0 


*That is, the strong law of large numbers states that 


ee ee eT 
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Now, for a given pair i and j, there will be ( : ) = 6 terms in the expansion that will 


equal X: om 2 Hence, upon expanding the preceding product and taking expectations 
term by term, it follows that 


n 


2 
=nK + 3n(n — I ELX? JE[X7] 


E[S4] = nE[X}] + 6 ( ) E[X?X7] 


where we have once again made use of the independence assumption. Now, since 
0 = Var(X?) = E[X#] — (EX?) 


we have 
(ELX?))” < ELX#] = K 


Therefore, from the preceding, we obtain 
E[S4] < nK + 3n(n — 1)K 


which implies that 


Therefore, 


(oe) 
But the preceding implies that, with probability 1, 3° S*/n* < oo. (For if there is a 
n=1 
positive probability that the sum is infinite, then its expected value is infinite.) But the 
convergence of a series implies that its nth term goes to 0; so we can conclude that, 
with probability 1, 


But if s /nt = (Sy /n)y* goes to 0, then so must S;,/n; hence, we have proven that, with 
probability 1, ‘ 
n 


—>0 as noo 


When yp, the mean of the Xj, is not equal to 0, we can apply the preceding argument 
to the random variables X; — yz to obtain that with probability 1, 


n 
i=1 
or, equivalently, 
: XG 
lim —= 
noo n 


which proves the result. 
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The strong law is illustrated by two modules on the text website that consider inde- 
pendent and identically distributed random variables which take on one of the values 
0, 1, 2, 3, and 4. The modules simulate the values of m such random variables; the 
proportions of time that each outcome occurs, as well as the resulting sample mean 


n 

>= Xj /n, are then indicated and plotted. When using these modules, which differ only 
i=1 
in the type of graph presented, one enters the probabilities and the desired value of n. 
Figure 8.2 gives the results of a simulation using a specified probability mass function 
and (a) n = 100, (b) m = 1000, and (c) n = 10,000. 

Many students are initially confused about the difference between the weak and 
the strong laws of large numbers. The weak law of large numbers states that, for any 
specified large value n*, (X, + --- + Xy«)/n* is likely to be near 4. However, it does 
not say that (X; + --- + X;,)/nis bound to stay near yw for all values of 1 larger than 
n*. Thus, it leaves open the possibility that large values of |(X, + --- + Xy)/n — wu 
can occur infinitely often (though at infrequent intervals). The strong law shows that 
this cannot occur. In particular, it implies that, with probability 1, for any positive 
value e, 


ae 


Enter the probabilities and the number of trials 
to be simulated. The output gives the total number 
of times each outcome occurs, and the average 

of all outcomes. 


Theoretical Mean = 2.05 


Sample Mean = 1.89 
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of all outcomes. 
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Enter the probabilities and the number of trials 
to be simulated. The output gives the total number 


and the average 


Theoretical Mean = 2.05 


Sample Mean = 2.078 
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The strong law of large numbers was originally proven, in the special case of 
Bernoulli random variables, by the French mathematician Borel. The general form of 
the strong law presented in Theorem 4.1 was proven by the Russian mathematician 
A. N. Kolmogorov. 


8.5 OTHER INEQUALITIES 


We are sometimes confronted with situations in which we are interested in obtaining 
an upper bound for a probability of the form P{X — yu = a}, where a is some positive 
value and when only the mean = E[X] and variance o* = Var(X) of the distribu- 
tion of X are known. Of course, since X¥ — uw = a > Oimplies that |X — y| = a, it 
follows from Chebyshev’s inequality that 


P(X 


However, as the following proposition shows, it turns out that we can do better. 


2 
—~p=a)= P(X — pl =a}=% when a>0 
a 


Proposition 5.1. One-sided Chebyshev inequality 
If X is a random variable with mean 0 and finite variance o”, then, for anya > 0, 


PIX =a} < 


oc 


o-2 + a& 
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Enter the probabilities and the number of trials 
to be simulated. The output gives the total number 
of times each outcome occurs, and the average 

of all outcomes. 
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Proof. Let b > 0 and note that 
X 2a isequivalentto X +b2a+b 
Hence, 


P(X =a}=P{X +b=a+4 bd} 
2 PL 4 by = a bj 


where the inequality is obtained by noting that sincea + b>0,X + b2=a+b 
implies that (¥ + b)* = (a + b)*. Upon applying Markov’s inequality, the 
preceding yields that 


PLX = po 
== (a+b) (a+ by 


Letting b = o*/a [which is easily seen to be the value of b that minimizes 
(0? + b*)/(a + b)?] gives the desired result. 
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EXAMPLE 5a 


If the number of items produced in a factory during a week is a random variable with 
mean 100 and variance 400, compute an upper bound on the probability that this 
week’s production will be at least 120. 


Solution. It follows from the one-sided Chebyshev inequality that 


4001 
400 + (20)? 2 


P{X = 120} = P{X — 100 = 20} < 


Hence, the probability that this week’s production will be 120 or more is at most a 
If we attempted to obtain a bound by applying Markov’s inequality, then we would 
have obtained 


E(X) 5 
P(X = 120} s ——=- 
120 6 
which is a far weaker bound than the preceding one. a 


Suppose now that Y has mean yw and variance o”. Since both ¥ — wand py — X 
have mean 0 and variance o”, it follows from the one-sided Chebyshev inequality 
that, fora > 0, 


o2 
a a ae 
and 
o2 
Ph = DS ae 


Thus, we have the following corollary. 


Corollary 5.1. If ELX] = wu and Var(X) = o”, then, fora > 0, 


2 
o 
PX = uw + a} = =z 
o~ +4 
2 


PX sp - < 
{ a a a 


EXAMPLE 5b 


A set of 200 people consisting of 100 men and 100 women is randomly divided into 
100 pairs of 2 each. Give an upper bound to the probability that at most 30 of these 
pairs will consist of a man and a woman. 


Solution. Number the men arbitrarily from 1 to 100, and for i = 1,2,... 100, let 


X= 1 if man /is paired with a woman 
‘“ )0. otherwise 


Then X, the number of man—woman pairs, can be expressed as 


100 


x= pee « 
i=1 
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Because man i is equally likely to be paired with any of the other 199 people, of which 
100 are women, we have 


100 
E[Xi] = PiXi = Y= 199 


Similarly, for i # j, 
EA A= PG a= 1,44 =1} 


_ 100 99 
~ 199 197 
where P{X; = 1|X; = 1} = 99/197, since, given that man / is paired with a woman, 


man j is equally likely to be paired with any of the remaining 197 people, of which 99 
are women. Hence, we obtain 


= P{X; = 1}P{X) = 1|X; = 1} 


100 


E[X] = )0 E[Xi] 
i=1 


100 

= (100) —— 

( 799 
= 50.25 


100 
Var(X) = )° Var(Xi) + 25° S > Cov(Xi, Xj) 


i<j 


2 
_ 100 100 99 a9 100 100 99 100 
199 199 2 199 197 199 


= 25.126 


The Chebyshev inequality then yields 


25.126 


P{X = 30} S P{|X — 50.25| = 20.25} = ——— & 
(20.25)2 


Thus, there are fewer than 6 chances in a hundred that fewer than 30 men will be 
paired with women. However, we can improve on this bound by using the one-sided 
Chebyshev inequality, which yields 


P(X < 30} = P(X < 50.25 — 20.25} 
25.126 
~ 25.126 + (20.25) 
~ 058 = 


When the moment generating function of the random variable X is known, we can 
obtain even more effective bounds on P{X = a}. Let 


M(t) = Efe] 
be the moment generating function of the random variable X. Then, fort > 0, 


P{X = a} = P{e* = el 
< Efe]e““ by Markov’s inequality 
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Similarly, fort < 0, 
P{X <a} = Ple* = e&% 
< Efe* ]e—@ 

Thus, we have the following inequalities, known as Chernoff bounds. 
Proposition 5.2. Chernoff bounds 

P(X =a} se "M(t) forall t > 0 

P(X <a} se "M(t) forall t <0 
Since the Chernoff bounds hold for all ¢ in either the positive or negative quadrant, 
we obtain the best bound on P{X = a} by using the ¢ that minimizes e"“ M(t). 
EXAMPLE 5c Chernoff bounds for the standard normal random variable 
If Z is a standard normal random variable, then its moment generating function is 
M(t) = et / 2. so the Chernoff bound on P{Z = a} is given by 

P{Z =a} < ee? forall t > 0 


2 /2-ta 


Now the value of t,t > 0, that minimizes e is the value that minimizes 72 /2 — ta, 


which is t = a. Thus, for a > 0, we have 
P{Z=ayse*? 
Similarly, we can show that, fora < 0, 
PIZ <a} <e = 


EXAMPLE 5d Chernoff bounds for the Poisson random variable 


If _X is a Poisson random variable with parameter A, then its moment generating func- 
tion is M(t) = e*'-). Hence, the Chernoff bound on P{X = i} is 


PIX =< PC Vet 430 


Minimizing the right side of the preceding inequality is equivalent to minimizing 
X(e' — 1) — it, and calculus shows that the minimal value occurs when e! = i/A. Pro- 
vided that i/A > 1, this minimizing value of ¢ will be positive. Therefore, assuming 
thati > 4 and letting e’ = i/A in the Chernoff bound yields 


aye 

i 

or, equivalently, 
e*(ea)! 


i 


PIX=i)< 


EXAMPLE 5e 


Consider a gambler who is equally likely to either win or lose 1 unit on every play, 
independently of his past results. That is, if X; is the gambler’s winnings on the ith 
play, then the X; are independent and 
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Pye tla= Pix] i= ; 


n 
Let S, = }> X; denote the gambler’s winnings after n plays. We will use the Chernoff 


i=l 
bound on P{S,, = a}. To start, note that the moment generating function of X; is 


étet 


Efe*] = : 


Now, using the McLaurin expansions of e’ and e~‘, we see that 


fr. Ff - F 
t a \ ! | | | ! | 
e+e *=ltit+tst+y + (1 b+ Fy 31 
er ff 
9 45g | 
oo pen 
=? —— 
Dig 
n=0 
=k 2h 
< oe as since (2n)! = n!2” 
Ni 
n=0 
— 2¢!"/2 


Therefore, 
E[e*] = ef /? 


Since the moment generating function of the sum of independent random variables 
is the product of their moment generating functions, we have 


Efe"] = (E[e*])" 


< ent’ /2 

Using the preceding result along with the Chernoff bound gives 

P{S, 2a} s eMen/2 4. 0) 
The value of ¢ that minimizes the right side of the preceding is the value that min- 
imizes nt*/2 — ta, and this value is t = a/n. Supposing that a > 0 (so that the 
minimizing ¢ is positive) and letting t = a/n in the preceding inequality yields 

P{S, 2a} s et ln as 0 
This latter inequality yields, for example, 


P{S1o = 6} S e-%6/9 w 1653 
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whereas the exact probability is 
P{Sj9 = 6} = P{gambler wins at least 8 of the first 10 games} 


10 10 10 
(3) + (3) + Go) 56 
- = = 0547 a 


20 1024 


The next inequality is one having to do with expectations rather than probabilities. 
Before stating it, we need the following definition. 


Definition 


A twice-differentiable real-valued function f(x) is said to be convex if f(x) = 0 for 
all x; similarly, it is said to be concave if f’ (x) = 0. 


Some examples of convex functions are f(x) = K. f(x) =e", and f(x) = —x!/" for 
x = 0. If f(x) is convex, then g(x) = —f(x) is concave, and vice versa. 


Proposition 5.3. Jensen’s inequality 
If f(x) is a convex function, then 


El f(X)] = fELX) 
provided that the expectations exist and are finite. 


Proof. Expanding f(x) in a Taylor’s series expansion about 4. = ELX] yields 


_ f'@@ - uy? 
2 


where & is some value between x and jw. Since f”(€) = 0, we obtain 


fo=fm +fWe - pv) 


f@m=fm + fWe — p) 


Hence, 


fO=fwmt+ fw —- pw) 


Taking expectations yields 


EL f(XO)] = fw + fWEX — wu] = fu) 


and the inequality is established. 


EXAMPLE 5f 


An investor is faced with the following choices: Either she can invest all of her money 
in a risky proposition that would lead to a random return X that has mean m, or 
she can put the money into a risk-free venture that will lead to a return of m with 
probability 1. Suppose that her decision will be made on the basis of maximizing the 
expected value of u(R), where R is her return and uw is her utility function. By Jensen’s 
inequality, it follows that if u is a concave function, then E[u(X)] = u(m), so the risk- 
free alternative is preferable, whereas if u is convex, then E[u(X)] = u(m), so the 
risky investment alternative would be preferred. 
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8.6 BOUNDING THE ERROR PROBABILITY WHEN APPROXIMATING A SUM OF INDEPENDENT 
BERNOULLI RANDOM VARIABLES BY A POISSON RANDOM VARIABLE 


In this section, we establish bounds on how closely a sum of independent Bernoulli 
random variables is approximated by a Poisson random variable with the same mean. 
Suppose that we want to approximate the sum of independent Bernoulli random 
variables with respective means p1,p2,...,Pn. Starting with a sequence Yj,..., Yn 
of independent Poisson random variables, with Y; having mean p;, we will construct 
a sequence of independent Bernoulli random variables Xj,...,X, with parameters 
P1;--+,Pn such that 


P{X; 4 Yi} S p for eachi 


n n 

Letting X¥ = >) X; and Y = )° Yj, we will use the preceding inequality to con- 
i=1 i=1 

clude that 


n 
PIX #Y}=)0 p7 
i=1 


Finally, we will show that the preceding inequality implies that, for any set of real 
numbers A, 


n 
\PixeAl— Ply <All = >, p: 
i=1 
Since X is the sum of independent Bernoulli random variables and Y is a Poisson 
random variable, the latter inequality will yield the desired bound. 
To show how the task is accomplished, let Y;,i = 1,..., be independent Pois- 


son random variables with respective means p;. Now let U;,...,U, be independent 
random variables that are also independent of the Y;’s and which are such that 


U;= 0 with probability (1 — pj)e? 
'“)1. with probability 1 — (1 — pje? 


This definition implicitly makes use of the inequality 
eP=1-p 
in assuming that (1 — p,)e?' = 1. 


Next, define the random variables Xj,i = 1,...,n, by 


_ jo ifY¥;=U;=0 
= {; otherwise 
Note that 


P(X; = 0} = P(Y; = O}P(U; = 0} =e P'(L — poe =1 — p; 
P(X; = 1} =1 — P(X; =0} =p; 
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Now, if X; is equal to 0, then so must Y; equal 0 (by the definition of X;). Therefore, 
P{X; # Yj} = P{X; =1,Y; # V} 
= P{Y;=0,X;=1} + P{Y; > 1} 
= P{Y;=0,U; =1} + P{Y; > 1} 
=e Pit — 1 — pp] + 1 — eP — pie? 
=pi — pie?! 
<p; (sincel — e? <p) 


Now let X = X; and Y = = Y;, and note that X is the sum of independent 


=1 =1 
Bernoulli random variables and Yi is Poisson with the expected value E[Y] = E[X] = 


y pi. Note also that the inequality X # Y implies that X; # Y; for some i, so 
i=1 


P{X # Y} S P{X; # Y; for some i} 


n 
< yo Pes # Yj} (Boole’s inequality) 
i=1 


n 
= se ra 
i=1 
For any event B, let Jz, the indicator variable for the event B, be defined by 


—_— 1 if B occurs 
B10 otherwise 


Note that, for any set of real numbers A, 
Tixeay — Tyveay S [xzy} 


The preceding inequality follows from the fact that, since an indicator variable is 
either 0 or 1, the left-hand side equals 1 only when J;ye4) = 1 and J;ye4) = 0. But 
this would imply that X € A and Y ¢ A, which means that X # Y, so the right side 
would also equal 1. Upon taking expectations of the preceding inequality, we obtain 


P(X € A} — P{Y EA} = P{X # Y} 
By reversing X and Y, we obtain, in the same manner, 

PLY € A} — P{X € A} = P{X # Y} 
Thus, we can conclude that 


|P{X ¢ A} — P{Y € A}| < P{X # Y} 


n 
Therefore, we have proven that with A = > pj, 
i=l 


n ea! 
Sxea} - OM = a 
i=1 


icA 
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Remark. When all the p; are equal to p, X is a binomial random variable. Hence, 
the preceding inequality shows that, for any set of nonnegative integers A, 


: ; —np i 
( : )r'a _ py 22 e€ ve < np” | 


icA icA 


SUMMARY 


Two useful probability bounds are provided by the Markov and Chebyshev inequali- 
ties. The Markov inequality is concerned with nonnegative random variables and says 
that, for X of that type, 

E(x] 


a 


PIX =a} < 


for every positive value a. The Chebyshev inequality, which is a simple consequence 
of the Markov inequality, states that if XY has mean yw and variance o7, then, for every 
positive k, 

P{|X — p| = ko} S RB 
The two most important theoretical results in probability are the central limit theorem 
and the strong law of large numbers. Both are concerned with a sequence of indepen- 
dent and identically distributed random variables. The central limit theorem says that 
if the random variables have a finite mean jz and a finite variance o”, then the distri- 
bution of the sum of the first n of them is, for large n, approximately that of a normal 
random variable with mean nj and variance no. That is, if X;,i = 1, is the sequence, 
then the central limit theorem states that, for every real number a, 


1 ao 2 
< SS x" /2 
n—- oo o/n | J 20 [oe . 


The strong law of large numbers requires only that the random variables in the sequence 
have a finite mean vz. It states that, with probability 1, the average of the first n of them 
will converge to yz as n goes to infinity. This implies that if A is any specified event 
of an experiment for which independent replications are performed, then the limit- 
ing proportion of experiments whose outcomes are in A will, with probability 1, equal 
P(A). Therefore, if we accept the interpretation that “with probability 1” means “with 
certainty,” we obtain the theoretical justification for the long-run relative frequency 
interpretation of probabilities. 


PROBLEMS 
8.1. Suppose that XY is a random variable with mean that the variance of a student’s test score is 
and variance both equal to 20. What can be said equal to 25. 
about P{0 < X < 40}? (b) What can be said about the probability that a 
8.2. From past experience, a professor knows that the student will score between 65 and 85? 
test score of a student taking her final examination (c) How many students would have to take the 
is arandom variable with mean 75. examination to ensure, with probability at 
(a) Give an upper bound for the probability that least .9, that the class average would be 
a student’s test score will exceed 85. Sup- within 5 of 75? Do not use the central limit 


pose, in addition, that the professor knows theorem. 


8.3. 


8.4. 


8.5. 


8.6. 


8.7. 


8.8. 


8.9. 


8.10. 


8.11. 


Use the central limit theorem to solve part (c) of 

Problem 2. 

Let X1,...,X29 be independent Poisson random 

variables with mean 1. 

(a) Use the Markov inequality to obtain a 
bound on 


20 
P p3 Xj > | 
1 
(b) Use the central limit theorem to approximate 
20 
P+) X > 15 
1 


Fifty numbers are rounded off to the nearest inte- 
ger and then summed. If the individual round- 
off errors are uniformly distributed over (—.5,.5), 
approximate the probability that the resultant sum 
differs from the exact sum by more than 3. 

A die is continually rolled until the total sum of 
all rolls exceeds 300. Approximate the probability 
that at least 80 rolls are necessary. 

A person has 100 light bulbs whose lifetimes are 
independent exponentials with mean 5 hours. If 
the bulbs are used one at a time, with a failed bulb 
being replaced immediately by a new one, approx- 
imate the probability that there is still a working 
bulb after 525 hours. 

In Problem 7, suppose that it takes a random time, 
uniformly distributed over (0, .5), to replace a 
failed bulb. Approximate the probability that all 
bulbs have failed by time 550. 

If X is a gamma random variable with parameters 
(n, 1), approximately how large need n be so that 


x 
| 


"| 

n 
Civil engineers believe that W, the amount of 
weight (in units of 1000 pounds) that a certain span 
of a bridge can withstand without structural dam- 
age resulting, is normally distributed with mean 
400 and standard deviation 40. Suppose that the 
weight (again, in units of 1000 pounds) of a car 
is a random variable with mean 3 and standard 
deviation .3. Approximately how many cars would 
have to be on the bridge span for the probability 
of structural damage to exceed .1? 

Many people believe that the daily change of price 
of a company’s stock on the stock market is a ran- 
dom variable with mean 0 and variance o?. That 
is, if Y, represents the price of the stock on the nth 
day, then 


> os| < .01? 


Yn =Y¥n-1 + Xn n2l 


where X1, X2,... are independent and identically 
distributed random variables with mean 0 and 


8.12. 


8.13. 


8.14. 


8.15. 


8.16. 
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variance o*. Suppose that the stock’s price today 
is 100. If c? = 1, what can you say about the prob- 
ability that the stock’s price will exceed 105 after 
10 days? 
We have 100 components that we will put in use in 
a sequential fashion. That is, component 1 is ini- 
tially put in use, and upon failure, it is replaced 
by component 2, which is itself replaced upon fail- 
ure by component 3, and so on. If the lifetime 
of component / is exponentially distributed with 
mean 10 + 7/10,i=1,...,100, estimate the prob- 
ability that the total life of all components will 
exceed 1200. Now repeat when the life distribu- 
tion of component 7 is uniformly distributed over 
(0,20 + i/5),i=1,..., 100. 
Student scores on exams given by a certain instruc- 
tor have mean 74 and standard deviation 14. This 
instructor is about to give two exams, one to a class 
of size 25 and the other to a class of size 64. 
(a) Approximate the probability that the average 
test score in the class of size 25 exceeds 80. 
Repeat part (a) for the class of size 64. 
Approximate the probability that the average 
test score in the larger class exceeds that of 
the other class by over 2.2 points. 
Approximate the probability that the average 
test score in the smaller class exceeds that of 
the other class by over 2.2 points. 
A certain component is critical to the operation of 
an electrical system and must be replaced immedi- 
ately upon failure. If the mean lifetime of this type 
of component is 100 hours and its standard devi- 
ation is 30 hours, how many of these components 
must be in stock so that the probability that the 
system is in continual operation for the next 2000 
hours is at least .95? 
An insurance company has 10,000 automobile pol- 
icyholders. The expected yearly claim per policy- 
holder is $240, with a standard deviation of $800. 
Approximate the probability that the total yearly 
claim exceeds $2.7 million. 
A.J. has 20 jobs that she must do in sequence, with 
the times required to do each of these jobs being 
independent random variables with mean 50 min- 
utes and standard deviation 10 minutes. M.J. has 
20 jobs that he must do in sequence, with the times 
required to do each of these jobs being indepen- 
dent random variables with mean 52 minutes and 
standard deviation 15 minutes. 
(a) Find the probability that A.J. finishes in less 
than 900 minutes. 
(b) Find the probability that M.J. finishes in less 
(c) 


(b) 
(c) 


(d) 


than 900 minutes. 
Find the probability 
before M.J. 


that A.J. finishes 
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8.17. 


8.18. 


8.19. 


8.20. 


8.1. 


8.2. 


8.3. 
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Redo Example 5b under the assumption that the 

number of man—woman pairs is (approximately) 

normally distributed. Does this seem like a reason- 
able supposition? 

Repeat part (a) of Problem 2 when it is known that 

the variance of a student’s test score is equal to 25. 

A lake contains 4 distinct types of fish. Suppose 

that each fish caught is equally likely to be any 

one of these types. Let Y denote the number of 
fish that need be caught to obtain at least one of 
each type. 

(a) Give an interval (a, b) such that Pfa = Y = 5} 
= .90. 

(b) Using the one-sided Chebyshev inequality, 
how many fish need we plan on catching so as 
to be at least 90 percent certain of obtaining 
at least one of each type. 

If X is a nonnegative random variable with mean 

25, what can be said about 

(a) ELX?]? 

(b) E[V Xx]? 

(c) Eflog X]? 

(d) Ele *)? 


8.21. 


8.22. 


8.23. 


Let X be a nonnegative random variable. 
Prove that 
AX = Cp? = exp = 
Would the results of Example 5f change if the 
investor were allowed to divide her money and 
invest the fractiona,0 < a < 1,in the risky propo- 
sition and invest the remainder in the risk-free 
venture? Her return for such a split investment 
would be R= aX + (1 — a)m. 
Let X be a Poisson random variable with mean 20. 
(a) Use the Markov inequality to obtain an upper 
bound on 
p= P{X = 26} 
(b) Use the one-sided Chebyshev inequality to 
obtain an upper bound on p. 
Use the Chernoff bound to obtain an upper 
bound on p. 
Approximate p by making use of the central 
limit theorem. 
Determine p by running an appropriate pro- 
gram. 


THEORETICAL EXERCISES 


If X has variance o7, then o, the positive square 
root of the variance, is called the standard devia- 
tion. If X has mean yp and standard deviation o, 
show that 


P{|X — p| = ko} = a 

If X has mean w and standard deviation o, the 
ratio r = ||/o is called the measurement signal- 
to-noise ratio of X. The idea is that X can be 
expressed as X = w + (X — «), with yw represent- 
ing the signal and X — w the noise. If we define 


|(X — yw)/u| = D as the relative deviation of X 
from its signal (or mean) jz, show that, fora > 0, 
P{D < a} =] — — 

— a2 


Compute the measurement signal-to-noise ratio— 
that is, |u|/o, where w = E[X] and 0” = Var(X)— 
of the following random variables: 

(a) Poisson with mean A; 

(b) binomial with parameters n and p; 

(c) geometric with mean 1/p; 

(d) uniform over (a,b); 

(e) exponential with mean 1/); 

(f) normal with parameters p, o2 


8.4. 


8.5. 


Let Z,;,n = 1, be a sequence of random variables 

and c aconstant such that, for each e > 0, P{|Z, — 

c| > ¢} > 0asn— om. Show that, for any bounded 

continuous function g, 
E[g(Zn)|—> gc) as) noo 

Let f(x) be a continuous function defined for 0 = 

x = 1. Consider the functions 


n 
k\ (n)\ x -k 
B,(x) = ~ — x)" 
n(X) > (=) ( ae: d= 2) 
k=0 
(called Bernstein polynomials) and prove that 
im Br(x) = fx) 


Hint: Let X1,X2,... be independent Bernoulli 
random variables with mean x. Show that 


B(x) = els (= + 7 + **)| 


and then use Theoretical Exercise 4. 

Since it can be shown that the convergence of 
By(x) to f(x) is uniform in x, the preceding rea- 
soning provides a probabilistic proof of the famous 
Weierstrass theorem of analysis, which states that 


8.6. 


8.7. 


8.8. 


8.9. 


8.1. 


8.2. 


8.3. 


8.4. 


any continuous function on a closed interval can be 

approximated arbitrarily closely by a polynomial. 

(a) Let X be a discrete random variable whose 
possible values are 1,2,.... If P(X = k} is 


nonincreasing in k = 1,2,..., prove that 
E[X] 
PIX =k} s=2 2 


(b) Let X be a nonnegative continuous random 
variable having a nonincreasing density func- 
tion. Show that 

2E[X] 

2 


forall x > 0 


f@®= 

x 

Suppose that a fair die is rolled 100 times. Let X; 

be the value obtained on the ith roll. Compute an 
approximation for 


100 
Pi[[“=o™ 1<a<6 
1 


Explain why a gamma random variable with 
parameters (t, 4) has an approximately normal dis- 
tribution when f is large. 

Suppose a fair coin is tossed 1000 times. If the first 
100 tosses all result in heads, what proportion of 


8.10. 


8.11. 


8.12. 


8.13. 
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heads would you expect on the final 900 tosses? 
Comment on the statement “The strong law of 
large numbers swamps, but does not compensate.” 
If X is a Poisson random variable with mean A, 
show that fori < A, 


e*(er)! 


il 


PIX <i} < 


Let X be a binomial random variable with param- 

eters n and p. Show that, fori > np, 

(a) minimum e~"E{e'*] occurs when f is such that 
t>0, 


t_ _ig 
oS (n—1)p’ 


(b) PX =i < 


where q =1 — p. 


Faye = py. 

The Chernoff bound on a standard normal random 
variable Z gives P{(Z > a} = e~“/?,a > 0. Show, 
by considering the density of Z, that the right side 
of the inequality can be reduced by the factor 2. 
That is, show that 


1 
PiZ>a}s oo a>0O 


Show that if E[X] < 0 and 6 # 0 is such that 
Efe’*] =1, then > 0. 


SELF-TEST PROBLEMS AND EXERCISES 


The number of automobiles sold weekly at a cer- 

tain dealership is a random variable with expected 

value 16. Give an upper bound to the probabil- 
ity that 

(a) next week’s sales exceed 18; 

(b) next week’s sales exceed 25. 

Suppose in Problem 1 that the variance of the 

number of automobiles sold weekly is 9. 

(a) Give a lower bound to the probability that 
next week’s sales are between 10 and 22, 
inclusively. 

(b) Give an upper bound to the probability that 
next week’s sales exceed 18. 

If 


E[X]=75 E[Y]=75 Var(X) = 10 
Var(Y) =12 Cov(x, Y)=-3 


give an upper bound to 

(a) P(X — Y| > 15}; 

(b) P{X > Y + 15}; 

(c) P{Y > X + 15}. 

Suppose that the number of units produced daily 
at factory A is arandom variable with mean 20 and 
standard deviation 3 and the number produced 


8.5. 


8.6. 


at factory B is a random variable with mean 
18 and standard deviation 6. Assuming indepen- 
dence, derive an upper bound for the probability 
that more units are produced today at factory B 
than at factory A. 

The amount of time that a certain type of compo- 
nent functions before failing is a random variable 
with probability density function 


fx) =2x O<x<1 


Once the component fails, it is immediately 

replaced by another one of the same type. If we 

let X; denote the lifetime of the ith component to 
n 


be put in use, then S, = > X; represents the time 


i=1 
of the nth failure. The long-term rate at which fail- 
ures occur, call it r, is defined by 
—. li n 

= pao S 
Assuming that the random variables Xj, i = 1, are 
independent, determine r. 
In Self-Test Problem 5, how many compo- 
nents would one need to have on hand to be 
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8.7. 


8.8. 


8.9. 


8.10. 


8.11. 
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approximately 90 percent certain that the stock 
will last at least 35 days? 

The servicing of a machine requires two separate 
steps, with the time needed for the first step being 
an exponential random variable with mean .2 hour 
and the time for the second step being an inde- 
pendent exponential random variable with mean 
.3 hour. If a repair person has 20 machines to ser- 
vice, approximate the probability that all the work 
can be completed in 8 hours. 

On each bet, a gambler loses 1 with probability .7, 
loses 2 with probability .2, or wins 10 with prob- 
ability .1. Approximate the probability that the 
gambler will be losing after his first 100 bets. 
Determine ¢ so that the probability that the repair 
person in Self-Test Problem 7 finishes the 20 jobs 
within time f is approximately equal to .95. 

A tobacco company claims that the amount of 
nicotine in one of its cigarettes is a random 
variable with mean 2.2 mg and standard devia- 
tion .3mg. However, the average nicotine con- 
tent of 100 randomly chosen cigarettes was 3.1 
mg. Approximate the probability that the average 
would have been as high as or higher than 3.1 if the 
company’s claims were true. 

Each of the batteries in a collection of 40 batter- 
ies is equally likely to be either a type A or a type 
B battery. Type A batteries last for an amount of 
time that has mean 50 and standard deviation 15; 


8.12. 


8.13. 


type B batteries last for an amount of time that has 

mean 30 and standard deviation 6. 

(a) Approximate the probability that the total life 
of all 40 batteries exceeds 1700. 

(b) Suppose it is known that 20 of the batteries 
are type A and 20 are type B. Now approx- 
imate the probability that the total life of all 
40 batteries exceeds 1700. 


A clinic is equally likely to have 2, 3, or 4 doctors 

volunteer for service on a given day. No matter 

how may volunteer doctors there are on a given 

day, the numbers of patients seen by these doctors 

are independent Poisson random variables with 

mean 30. Let X denote the number of patients 

seen in the clinic on a given day. 

(a) Find E[X]. 

(b) Find Var(X). 

(c) Use a table of the standard normal probability 
distribution to approximate P{X > 65}. 

The strong law of large numbers states that, with 

probability 1, the successive arithmetic averages 

of a sequence of independent and identically dis- 

tributed random variables converge to their com- 

mon mean j. What do the successive geometric 

averages converge to? That is, what is 


n 
: .\l/n 
sa 
= 
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THE POISSON PROCESS 


Before we define a Poisson process, let us recall that a function f is said to be o(h) if 


i fh) 
im — = 


0. 
h—>0 h 


That is, f is o(h) if, for small values of h,f(h) is small even in relation to h. Sup- 
pose now that “events” are occurring at random points at time, and let N(t) denote 
the number of events that occur in the time interval [0,¢]. The collection of random 
variables {N(t),t = 0} is said to be a Poisson process having rate 2, > 0, if 


(7) N(O) = 0. 
(ii) The numbers of events that occur in disjoint time intervals are independent. 
(iii) The distribution of the number of events that occur in a given interval depends 
only on the length of that interval and not on its location. 
(iv) P{N(h) = 1} =Ah 4+ o(h). 
(v) P{N(h) = 2} = oh). 


Thus, condition (i) states that the process begins at time 0. Condition (ii), the inde- 
pendent increment assumption, states, for instance, that the number of events that 
occur by time ¢ [that is, N(A] is independent of the number of events that occur 
between tandt + s [that is, N(t + s) — N(f)]. Condition (iii), the stationary increment 
assumption, states that the probability distribution of N(t + s) — N(#) is the same for 
all values of ¢. 

In Chapter 4, we presented an argument, based on the Poisson distribution being 
a limiting version of the binomial distribution, that the foregoing conditions imply 
that N(¢t) has a Poisson distribution with mean At. We will now obtain this result by a 
different method. 


Lemma 1.1 
For a Poisson process with rate i, 


P{N(t) = 0} =e" 
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Proof. Let Po(t) = P{N(t) = 0}. We derive a differential equation for Po(f) in the 
following manner: 


Pott + h) = P{N(t + h) = 0} 
= P{N(@t) =0,N(¢ + h) — NN =0} 
= P{N(t) = O}P{N(t + h) — N() = 0} 
= Po(t)[1 — ah + o(h)] 


where the final two equations follow from condition (ii) plus the fact that condi- 
tions (iv) and (v) imply that P{N(h) = 0} = 1 — AM + o(h). Hence, 


Polt + ® SFOs a oth) 


Now, letting 4-0, we obtain 


Po(t) = —APo(t) 


or, equivalently, 
Po __ 
Po(t) 
which implies, by integration, that 


log Po(t) = —At + ¢ 


or 
Po(t) = Ke“ 


Since P9(0) = P{N(0) = 0} = 1, we arrive at 


Po(t) =e“ 


For a Poisson process, let 7; denote the time the first event occurs. Further, for 
n > 1, let T;, denote the time elapsed between the (n — 1)st and the nth event. The 
sequence {7),,n = 1,2,...} is called the sequence of interarrival times. For instance, if 
T, = 5 and T> = 10, then the first event of the Poisson process would have occurred 
at time 5 and the second at time 15. 

We shall now determine the distribution of the 7,,. To do so, we first note that the 
event {7 > ft} takes place if and only if no events of the Poisson process occur in the 
interval [0, ¢]; thus, 

Ph = h=Prwoesyse" 


Hence, 7; has an exponential distribution with mean 1/1. Now, 
P{T2 > th= E[P{T2 > t|T,}] 
However, 


P{Tz > t\|T,; = 5s} = P{0 events in (s,s + ¢]|T; =s} 
= P{0 events in (s,s + ¢]} 


_ et 
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where the last two equations followed from the assumptions about independent and 
stationary increments. From the preceding, we conclude that 7> is also an exponen- 
tial random variable with mean 1/A and, furthermore, that T> is independent of T. 
Repeating the same argument yields Proposition 1.1. 


Proposition 1.1. 7), 7>,... are independent exponential random variables, each with 
mean 1/2. 


Another quantity of interest is S,, the arrival time of the nth event, also called the 
waiting time until the nth event. It is easily seen that 


n 
= yr n=1 
i=1 


hence, from Proposition 1.1 and the results of Section 5.6.1, it follows that S,, has a 
gamma distribution with parameters n and i. That is, the probability density of S, is 
given by 
-1 
= gag (Ax)” 
fs, (x) =e “a Dt x=0 
We are now ready to prove that N(f) is a Poisson random variable with mean At. 

Theorem 1.1. For a Poisson process with rate i, 


ent)" 


P(N) =n} = — 


Proof. Note that the nth event of the Poisson process will occur before or at time 
tif and only if the number of events that occur by f is at least n. That is, 


N®zneS,=t 
so 


PIN() =n} = PIN() =n} — PIN) =n + VY 
= P{Sp = t} = P{Sp41 = t} 


t x n—-1 t 2: n 
= - pele dx: = / pe OP dx 
0 0 


(n — 1)! n! 
But the integration-by-parts formula fudv = uv — f{ vdu with u = e~** and 
dv = ad[(ax)""!/(n — 1)!] dx yields 
t x n-1 At)” t Ax)? 
/ jo a dx = eo GD" ) ts 1 ie a dx 
0 (n — 1)! n! 0 n! 
which completes the proof. 
9.2. MARKOV CHAINS 
Consider a sequence of random variables Xo, X1,..., and suppose that the set of pos- 
sible values of these random variables is {0,1,...,M}. It will be helpful to interpret 


Xn as being the state of some system at time n, and, in accordance with this interpre- 
tation, we say that the system is in state i at time n if X,, = i. The sequence of random 
variables is said to form a Markov chain if, each time the system is in state i, there is 
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some fixed probability—call it P;;—that the system will next be in state j. That is, for 
allio,...,in—1,i,], 


P{Xny1 = j|Xn = 1, Xn-1 = in-1,...,X1 = 1, XO = io} = Py 


The values P7j,0 = i = M,0O =j S N, are called the transition probabilities of the 
Markov chain, and they satisfy 


(Why?) It is convenient to arrange the transition probabilities P; in a square array as 
follows: 

Poo Po. -:: Pom 
Pio Pu -:: Pim 


Puo Pm -:: Pum 


Such an array is called a matrix. 

Knowledge of the transition probability matrix and of the distribution of Xo enables 
us, in theory, to compute all probabilities of interest. For instance, the joint probabil- 
ity mass function of X0,..., Xn is given by 


P(X, = in, Xy-1 = In-1,.--,X1 = 11, X0 = io} 
= P{Xpn=In|Xn-1 = In-1,---,X0=lo}P{Xn-1 = In-1,---,X0 = to} 
Loi’ Anet = hie =i} 


and continual repetition of this argument demonstrates that the preceding is equal to 


Pin syint ina, ina Pit, in-Pig, 4 PLX0 = to} 


EXAMPLE 2a 


Suppose that whether it rains tomorrow depends on previous weather conditions only 
through whether it is raining today. Suppose further that if it is raining today, then it 
will rain tomorrow with probability a, and if it is not raining today, then it will rain 
tomorrow with probability 6. 

If we say that the system is in state 0 when it rains and state 1 when it does not, 
then the preceding system is a two-state Markov chain having transition probability 
matrix 


al-a 
Pi- p 
That is, P99 =a =1 — Po,Pip =f =1 — Py. | 


EXAMPLE 2b 


Consider a gambler who either wins 1 unit with probability p or loses 1 unit with 
probability 1 — p at each play of the game. If we suppose that the gambler will quit 
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playing when his fortune hits either 0 or M, then the gambler’s sequence of fortunes 
is a Markov chain having transition probabilities 


Peigepel = Pg t=1j4M@—1 
Poo = Pum = 1 | 


EXAMPLE 2c 


The husband-and-wife physicists Paul and Tatyana Ehrenfest considered a concep- 
tual model for the movement of molecules in which M molecules are distributed 
among 2 urns. At each time point one of the molecules is chosen at random and 
is removed from its urn and placed in the other one. If we let X,, denote the number 
of molecules in the first urn immediately after the nth exchange, then {Xo, X1,...} is 
a Markov chain with transition probabilities 


naa 0O=i=s=M 


M 
Pui 0O=is=M 


Thus, for a Markov chain, Pj; represents the probability that a system in state i 
will enter state j at the next transition. We can also define the two-stage transition 


probability Py that a system presently in state i will be in state j after two additional 
transitions. That is, 
2 ; é 
PY? = P(Xno=j\Xm =i} 


The Pe can be computed from the Pj as follows: 


PO = P{X, = j\Xo =i} 
M 
= )o P(X, =j,X1 = k|Xo =} 
k=0 
M 
= SP P(X) = 1X1 = k, Xo = P(X] = kX = i) 
k=0 


M 
=) Pela 
k=0 


In general, we define the n-stage transition probabilities, denoted as pe , by 


PP = PGin =] nad 
Proposition 2.1, known as the Chapman—Kolmogorov equations, shows how the ee 
can be computed. 
Proposition 2.1. The Chapman—Kolmogorov equations 


M 
a = pee eae foralO <r<n 
k=0 
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Proof: 


P® = P{X, = j\Xo=3} 
= SPX = j,X,=k|Xp = 3} 
k 


=) P(Xy = |X, = k, Xo = P(X, = k|Xo = i) 


: 

—_ (n—r) p(r) 

= Py Pit 
k 


EXAMPLE 2d A random walk 


An example of a Markov chain having a countably infinite state space is the random 
walk, which tracks a particle as it moves along a one-dimensional axis. Suppose that 
at each point in time the particle will move either one step to the right or one step to 
the left with respective probabilities p and 1 — p. That is, suppose the particle’s path 
follows a Markov chain with transition probabilities 


Pipi =p=1 = Ppy 4 t= O34 lip252 


If the particle is at state i, then the probability that it will be at state j after n transitions 
is the probability that (n — i + /)/2 of these steps are to the right andn — [(v —i+ 
j)/2] = (n + i — j)/2 are to the left. Since each step will be to the right, independently 
of the other steps, with probability p, it follows that the above is just the binomial 
probability 


i ‘is (n-itp/2(4 py (nti-j)/2. 
i a (l— Pp) 


where x} is taken to equal 0 when x is not a nonnegative integer less than or equal 


to n. The preceding formula can be rewritten as 


2 _ 


2n +1 2 
Poel = € eye ae Joa py ' 


k =0,+1,...,2n,-(n + 1) i] 


Although the Pe denote conditional probabilities, we can use them to derive 
expressions for unconditional probabilities by conditioning on the initial state. For 
instance, 


PIX, =N= >) PO =jlXo = AP =H} 
= PY? P{Xo = i} 


For a large number of Markov chains, it turns out that oe converges, aS N00, toa 
value x; that depends only on j. That is, for large values of n, the probability of being 
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in state j after n transitions is approximately equal to 7;, no matter what the initial 
state was. It can be shown that a sufficient condition for a Markov chain to possess 
this property is that, for some n > 0, 

P; > 0 foralli,j=0,1,...,M (21) 


Markov chains that satisfy Equation (2.1) are said to be ergodic. Since Proposition 2.1 
yields 


M 

(n+1) _ ()p. 

i = » Pi Pri 
k=0 


it follows, by letting n—oo, that, for ergodic chains, 


M 
qq = ;2 TKP kj (2.2) 
k=0 


M 
Furthermore, since 1 = >> p we also obtain, by letting noo, 
j=0 


ya] (2.3) 


In fact, it can be shown that the 7;,0 = j = M, are the unique nonnegative solutions 
of Equations (2.2) and (2.3). All this is summed up in Theorem 2.1, which we state 
without proof. 

Theorem 2.1. For an ergodic Markov chain, 


: (n) 
m= lim P.. 
I p00 


exists, and the 7,0 = j = M, are the unique nonnegative solutions of 


M 
mj = >) meP Hy 
k=0 
M 
w= 1 


EXAMPLE 2e 


Consider Example 2a, in which we assume that if it rains today, then it will rain tomor- 
row with probability a, and if it does not rain today, then it will rain tomorrow with 
probability 6. From Theorem 2.1, it follows that the limiting probabilities zo and 
of rain and of no rain, respectively, are given by 


™m =am + Bry 
m=(1— a) + — Bm 
mt +71 =1 
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which yields 
B 1l-—a 


a oe ae a oy pee 


For instance, if a = .6 and 6 = .3, then the limiting probability of rain on the nth day 
3 
is 79 = 5. | 


The quantity 7; is also equal to the long-run proportion of time that the Markov 
chain is in state j,j = 0,...,M. To see intuitively why this might be so, let P; denote 
the long-run proportion of time the chain is in state j. (It can be proven using the 
strong law of large numbers that, for an ergodic chain, such long-run proportions 
exist and are constants.) Now, since the proportion of time the chain is in state k is 
Px, and since, when in state k, the chain goes to state j with probability P,;, it follows 
that the proportion of time the Markov chain is entering state j from state k is equal 
to P;,P;j;. Summing over all k shows that P;, the proportion of time the Markov chain 
is entering state j, satisfies 


P= » Py Pj 
k 


Since clearly it is also true that 


Sea 
j 


it thus follows, since by Theorem 2.1 the 7,7 = 0,...,M are the unique solution of 
the preceding, that P; = 7j,j = 0,...,M. The long-run proportion interpretation of 7; 
is generally valid even when the chain is not ergodic. 


EXAMPLE 2f 
Suppose in Example 2c that we are interested in the proportion of time that there are 
j molecules in urn 1, j = 0,...,M. By Theorem 2.1, these quantities will be the unique 
solution of 
1 
TM = X uM 
Mmy pd jad: . 
T= Td ee P= Tyagngd 
=ny-1X — 
FM = Tia, ae 
M 
a7! 
j=0 


However, as it is easily checked that 


myst" . 
cote Te =0,...,M 
m=(“)(5) j=0..., 


satisfy the preceding equations, it follows that these are the long-run proportions of 
time that the Markov chain is in each of the states. (See Problem 11 for an explanation 
of how one might have guessed at the foregoing solution.) | 
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9.3 SURPRISE, UNCERTAINTY, AND ENTROPY 


Consider an event £ that can occur when an experiment is performed. How surprised 
would we be to hear that E does, in fact, occur? It seems reasonable to suppose that 
the amount of surprise engendered by the information that EF has occurred should 
depend on the probability of E. For instance, if the experiment consists of rolling a 
pair of dice, then we would not be too surprised to hear that EF has occurred when 
E represents the event that the sum of the dice is even (and thus has probability 5). 
whereas we would certainly be more surprised to hear that EF has occurred when EF is 
the event that the sum of the dice is 12 (and thus has probability 36): 

In this section, we attempt to quantify the concept of surprise. To begin, let us 
agree to suppose that the surprise one feels upon learning that an event EF has occurred 
depends only on the probability of E, and let us denote by S(p) the surprise evoked 
by the occurrence of an event having probability p. We determine the functional form 
of S(p) by first agreeing on a set of reasonable conditions that S(p) should satisfy and 
then proving that these axioms require that S(p) have a specified form. We assume 
throughout that S(p) is defined for all0 < p < 1, but is not defined for events having 
p=0. 

Our first condition is just a statement of the intuitive fact that there is no surprise 
in hearing that an event which is sure to occur has indeed occurred. 


Axiom 1 
S(1) =0 


Our second condition states that the more unlikely an event is to occur, the greater 
is the surprise evoked by its occurrence. 


Axiom 2 
S(p) is a strictly decreasing function of p; that is, if p < g,then S(p) > S(q). 


The third condition is a mathematical statement of the fact that we would intu- 
itively expect a small change in p to correspond to a small change in S(p). 


Axiom 3 
S(p) is a continuous function of p. 


To motivate the final condition, consider two independent events E and F having 
respective probabilities P(E) = p and P(F) = q. Since P(EF) = pg, the surprise 
evoked by the information that both E and F have occurred is S(pq). Now, suppose 
that we are told first that E has occurred and then, afterward, that F has also occurred. 
Since S(p) is the surprise evoked by the occurrence of EF, it follows that S(pq) — 
S(p) represents the additional surprise evoked when we are informed that F has also 
occurred. However, because F is independent of E, the knowledge that F occurred 
does not change the probability of F; hence, the additional surprise should just be 
S(q). This reasoning suggests the final condition. 


Axiom 4 
S(pq) = S(—p) + Sq) Ox<psil, O<qe=il1 


We are now ready for Theorem 3.1, which yields the structure of S(p). 
Theorem 3.1. [f S(-) satisfies Axioms I through 4, then 


S(p) = —Clog, p 


where C is an arbitrary positive integer. 
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Proof. \t follows from Axiom 4 that 


S(p?) = S(p) + S(p) = 2S(p) 


and by induction that 
S(p) = mS(p) (3.1) 


Also, since, for any integral n, S(p) = S(pi/n . <pliy =n S(p'/"), it follows that 


1 
Sip") = —S(p) (3.2) 
Thus, from Equations (3.1) and (3.2), we obtain 


Sp") = mS(p'"") 
m 
= —S(p) 
n 
which is equivalent to 
S(p*) = xS(p) (3.3) 


whenever x is a positive rational number. But by the continuity of S (Axiom 3), it 
follows that Equation (3.3) is valid for all nonnegative x. (Reason this out.) 


Now, for any p,0 < p = 1, let x = —log,p. Then p = (3). and from Equa- 


tion (3.3), 
LY 1 
S(p) =S ((5) =xS (5) = —Clog, p 


where C= $($) > S(1) =0 by Axioms 2 and 1. 


It is usual to let C equal 1, in which case the surprise is said to be expressed in units 
of bits (short for binary digits). 

Next, consider a random variable X that must take on one of the values x1,...,xy 
with respective probabilities p;,..., py. Since — log p; represents the surprise evoked 
if X takes on the value x;," it follows that the expected amount of surprise we shall 
receive upon learning the value of X is given by 


n 
H(X) = — 3 pilogpi 
i=1 


The quantity H(X) is known in information theory as the entropy of the random 
variable X. (In case one of the pj = 0, we take 0 log 0 to equal 0.) It can be shown 
(and we leave it as an exercise) that H(X) is maximized when all of the p; are equal. 
(Is this intuitive?) 

Since H(X) represents the average amount of surprise one receives upon learning 
the value of X, it can also be interpreted as representing the amount of uncertainty 
that exists as to the value of X. In fact, in information theory, H(X) is interpreted as 
the average amount of information received when the value of X is observed. Thus, 
the average surprise evoked by X, the uncertainty of X, or the average amount of 


tFor the remainder of this chapter, we write log x for logy x. Also, we use In x for log, x. 
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information yielded by X all represent the same concept viewed from three slightly 
different points of view. 

Now consider two random variables X and Y that take on the respective values 
X1,...,X%m and yj,...,¥m With joint mass function 


P(xXi, yj) = PIX = xi, Y = yj} 


It follows that the uncertainty as to the value of the random vector (X, Y), denoted 
by H(X, Y), is given by 


H(X,Y) =- >>> pGai.yj) log pi. yj) 


J 


Suppose now that Y is observed to equal y;. In this situation, the amount of uncer- 
tainty remaining in X is given by 


Hy-y(X) = — )~ p(ily;) log p(xily;) 


L 


where 


P(xilyj) = PLX = xil¥ = yj} 
Hence, the average amount of uncertainty that will remain in X after Y is observed 
is given by 
Hy(X) = > Hy=y,(X)py(y) 
j 
where 
py(yj) = P{Y = yj} 


Proposition 3.1 relates H(X, Y) to H(Y) and Hy(X). It states that the uncertainty as 
to the value of X and Y is equal to the uncertainty of Y plus the average uncertainty 
remaining in X when Y is to be observed. 


Proposition 3.1. 
A(X, Y)= H(Y) + Hy(X) 


Proof. Using the identity p(x, yj) = py (j)p(ilyj) yields 


H(X,Y) =— 7) pei. y;) log pO.) 
ij 
=- S03 py&)pGilyp[logpy(y) + logpily))] 
ij 
=— Spy) log py (yj) > polyp) 
j i 
— doPyo) Dd Poilys) log p(xily;) 
= ae + i 


It is a fundamental result in information theory that the amount of uncertainty in 
a random variable X will, on the average, decrease when a second random variable 
Y is observed. Before proving this statement, we need the following lemma, whose 
proof is left as an exercise. 
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Lemma 3.1 


Inx=x-1<x>0 


with equality only at x = 1. 
Theorem 3.2. 
Hy(X) < H(X) 
with equality if and only if X and Y are independent. 
Proof: 
Hy(X) — H(X)=— >> pily)) logip Gly) 1p) 
io] 


+ S° >" pGi,yj) log pi) 


J 


=O pay) oe aed 
7, 


D(xily;) 


< loge >) p(ui.y) EM — 1] by Lemma 3.1 
- P(xily;) 


= loge S> > pepo) = Y> > Poy) 
j J 


i I 


= loge[{1 — 1] 
=0 


9.4 CODING THEORY AND ENTROPY 


Suppose that the value of a discrete random vector X is to be observed at location 
A and then transmitted to location B via a communication network that consists of 
two signals, 0 and 1. In order to do this, it is first necessary to encode each possible 
value of X in terms of a sequence of 0’s and 1’s. To avoid any ambiguity, it is usually 
required that no encoded sequence can be obtained from a shorter encoded sequence 


by adding more terms to the shorter. 


For instance, if X can take on four possible values x1, x2,x3, and x4, then one pos- 


sible coding would be 
x, o> 00 
x2 <-> 01 


(4.1) 


x3 < 10 
x4 = 11 


That is, if XY = x ;, then the message 00 is sent to location B, whereas if X = x2, then 


01 is sent to B, and so on. A second possible coding is 
xy 0 


x2 <= 10 


(4.2) 


x3. <> 110 
x4 111 
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However, a coding such as 


xy 0 
nol 
x3 <= 00 
x4 <= O1 


is not allowed because the coded sequences for x3 and x4 are both extensions of the 
one for x1. 

One of the objectives in devising a code is to minimize the expected number of 
bits (that is, binary digits) that need to be sent from location A to location B. For 
example, if 


1 
PIX =m} = 5 
1 
P{X =x} = 4 
dl 
PIX = x3} = 5 
1 
PIX = 44} = 5 


then the code given by Equation (4.2) would expect to send 5(1) 4 (2) 5 (3) 
3(3) = 1.75 bits, whereas the code given by Equation (4.1) would expect to send 2 
bits. Hence, for the preceding set of probabilities, the encoding in Equation (4.2) is 
more efficient than that in Equation (4.1). 

The preceding discussion raises the following question: For a given random 
vector X, what is the maximum efficiency achievable by an encoding scheme? The 
answer is that, for any coding, the average number of bits that will be sent is at least 
as large as the entropy of X. To prove this result, known in information theory as the 
noiseless coding theorem, we shall need Lemma 4.1. 


Lemma 4.1 

Let X take on the possible values x1,...,xjy. Then, in order to be able to encode 
the values of X in binary sequences (none of which is an extension of another) of 
respective lengths 11,...,”N, it is necessary and sufficient that 


i=1 


Proof. For a fixed set of N positive integers n1,...,ny, let w; denote the number 
of the n; that are equal to j,j = 1,.... For there to be a coding that assigns 7; 
bits to the value x;,i = 1,...,N, it is clearly necessary that w,; = 2. Furthermore, 
because no binary sequence is allowed to be an extension of any other, we must 
have w2 = 2? — 2w. (This follows because 2” is the number of binary sequences 
of length 2, whereas 2w, is the number of sequences that are extensions of the 
w, binary sequence of length 1.) In general, the same reasoning shows that we 
must have 


Wig OP Se gd eg ees (4.3) 
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for n = 1,.... In fact, a little thought should convince the reader that these con- 
ditions are not only necessary, but also sufficient for a code to exist that assigns nj; 
bits toxj,i=1,...,N 


Rewriting inequality (4.3) as 
Wie > Wes 2 iy oe be hy So. ee 1 ncn 


and dividing by 2” yields the necessary and sufficient conditions, namely, 
n 1 j 
Yow; (5) <1  foralln (4.4) 


7 j 
However, because > w; (3) is increasing in n, it follows that Equation (4.4) will 


j=l 
ss ; 
12 
-(—-)|) =1 
, (5) 


be true if and only if 
j=1 


The result is now established, since, by the definition of w; as the number of n; that 
equal j, it follows that 
N 


rn(3) EG) 


J 


We are now ready to prove Theorem 4.1. 


Theorem 4.1 The noiseless coding theorem 
Let X take on the values x1,...,xy with respective probabilities p(x1),...,D(XN). 
Then, for any coding of X that assigns nj; bits to xi, 


N N 
Yo nip) = H(X) = — 7 pai) log pi) 


i=1 i=1 


N 
Proof. Let P; = p(xi),qi = omy y22-", i=1,...,N. Then 
j=l 


N N 
P; P; 
— y > Pjlog (=) a —loge )> Pjln (=) 
=i a i=l we 


N 
loge iS Pin (4) 
i=1 / 


N 
loge > Pi (4 — i) by Lemma 3.1 
i=1 : 


II 


IA 


N N 
=0 since SP = Soi =1 
i=1 i=1 
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Hence, 
N N 
- > Pilog P; =. S> Pilog gi 
i=l i=1 
N N 
— Yar + log yo 
i=l j=l 
N 
< > njP; by Lemma 4.1 
i=l 
EXAMPLE 4a 


Consider a random variable X with probability mass function 


1 1 ree | 
P(x) = 5 P(x2) = Z p(x3) = p(x4) = 8 
Since 


1 1 1 1 1 1 
H(xX)=- 5 logs + q leg + q lB 


2 4 4 
_1,2,3 

2° 4° 4 
= 1.75 


it follows from Theorem 4.1 that there is no more efficient coding scheme than 


xy << 0 

x2 > 10 

x3 110 

x4 111 a 

For most random vectors, there does not exist a coding for which the average 
number of bits sent attains the lower bound H(X). However, it is always possible 
to devise a code such that the average number of bits is within 1 of H(X). To prove 
this, define n; to be the integer satisfying 
—logp(i) = nj < —logp(xi) + 1 


Now, 
N 


N N 
LS aN < 2 = S> piri) =1 
All i=1 


i=1 


so, by Lemma 4.1, we can associate sequences of bits having lengths n; with the x;,i = 
1,...,N. The average length of such a sequence, 


N 
L= > nip) 
i=1 
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satisfies 
N N 
— > p(x) log pi) = L < — p(w) logp(x) + 1 
i=1 i=1 
or 
HOO SL <= HOO +1 
EXAMPLE 4b 


Suppose that 10 independent tosses of a coin having probability p of coming up heads 
are made at location A and the result is to be transmitted to location B. The outcome 
of this experiment is a random vector X = (Xj,..., X19), where X; is 1 or 0 according 
to whether or not the outcome of the ith toss is heads. By the results of this section, it 
follows that L, the average number of bits transmitted by any code, satisfies 


AX)sL 


with 
Ls=HA(X)+1 


for at least one code. Now, since the X; are independent, it follows from Proposi- 
tion 3.1 and Theorem 3.2 that 


N 
BX) = A G.0.. X= >) 
i=1 


= —10[plogp + (1 — p)log(1 — p)] 


Ifp = i then H(X) = 10, and it follows that we can do no better than just encoding 
X by its actual value. For example, if the first 5 tosses come up heads and the last 5 
tails, then the message 1111100000 is transmitted to location B. 

However, if p # i we can often do better by using a different coding scheme. For 


instance, if p = e then 


fi L 3. 3 
A(X) = 10 (F108 3 loz) = 8.11 


Thus, there is an encoding for which the average length of the encoded message is no 
greater than 9.11. 

One simple coding that is more efficient in this case than the identity code is to 
break up (X1,...,X109) into 5 pairs of 2 random variables each and then, for i = 
1, 3, 5, 7, 9, code each of the pairs as follows: 


X; = 0,Xj41 =0 - 0 
Y= 0% = 1 10 
Y= 1,24 =0 > 116 
ee 1, Xj44 =1<e1l1l1 


The total message transmitted is the successive encodings of the preceding pairs. 

For instance, if the outcome TTTHHTTTTH is observed, then the message 01011 
0010 is sent. The average number of bits needed to transmit the message with this 
code is 
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[A OOO @]-¥ 


= 8.44 a 


Up to this point, we have assumed that the message sent at location A is received 
without error at location B. However, there are always certain errors that can occur 
because of random disturbances along the communications channel. Such random 
disturbances might lead, for example, to the message 00101101, sent at A, being 
received at B in the form 01101101. 

Let us suppose that a bit transmitted at location A will be correctly received at 
location B with probability p, independently from bit to bit. Such a communications 
system is called a binary symmetric channel. Suppose further that p = .8 and we 
want to transmit a message consisting of a large number of bits from A to B. Thus, 
direct transmission of the message will result in an error probability of .20 for each 
bit, which is quite high. One way to reduce this probability of bit error would be to 
transmit each bit 3 times and then decode by majority rule. That is, we could use the 
following scheme: 


Encode Decode Encode Decode 
000 111 
001 110 

0— 000 010 —>0 1-111 101 —>1 
100 011 


Note that if no more than one error occurs in transmission, then the bit will be 
correctly decoded. Hence, the probability of bit error is reduced to 


(2) + 3(.2)7(.8) = .104 


a considerable improvement. In fact, it is clear that we can make the probability of 
bit error as small as we want by repeating the bit many times and then decoding by 
majority rule. For instance, the scheme 


Encode Decode 


O0—string of 170’s_ By majority rule 
1—string of 17 1’s 


will reduce the probability of bit error to below .01. 

The problem with this type of encoding scheme is that, although it decreases the 
probability of bit error, it does so at the cost of also decreasing the effective rate of 
bits sent per signal. (See Table 9.1.) 

In fact, at this point it may appear inevitable to the reader that decreasing the 
probability of bit error to 0 always results in also decreasing the effective rate at which 
bits are transmitted per signal to 0. However, a remarkable result of information 
theory known as the noisy coding theorem and due to Claude Shannon demonstrates 
that this is not the case. We now state this result as Theorem 4.2. 
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TABLE 9.1: Repetition of Bits Encoding Scheme 


Probability of error Rate 


(per bit) (bits transmitted per signal) 
.20 1 

10 33 (= 4) 

01 06 (= yy) 


Theorem 4.2 The noisy coding theorem 
There is anumber C such that, for any value R which is less than C, and for any ¢ > 0, 
there exists a coding—decoding scheme that transmits at an average rate of R bits sent 
per signal and with an error (per bit) probability of less than ¢. The largest such 
value of C—call it C*+ —is called the channel capacity, and for the binary symmetric 
channel, 

C*=1 + plogp + (1 — p)log(1 — p) 


SUMMARY 


The Poisson process having rate A is a collection of random variables {N(f), t = 0} that 
relate to an underlying process of randomly occurring events. For instance, N(f) rep- 
resents the number of events that occur between times 0 and ¢. The defining features 
of the Poisson process are as follows: 


(i) The number of events that occur in disjoint time intervals are independent. 


(ii) The distribution of the number of events that occur in an interval depends only 
on the length of the interval. 


(iii) Events occur one at a time. 
(iv) Events occur at rate i. 


It can be shown that N(f) is a Poisson random variable with mean At. In addition, 
if T;,i = 1, are the times between the successive events, then they are independent 
exponential random variables with rate i. 

A sequence of random variables X;,,n = 0, each of which takes on one of the 
values 0,...,M, is said to be a Markov chain with transition probabilities P; ; if, for 
all n,io,...,in,1,], 

P{Xn41 = [Xn = 1 Xn-1 = in-1,---,X0 = lo} = Pij 


If we interpret X;, as the state of some process at time n, then a Markov chain is a 
sequence of successive states of a process which has the property that whenever it 
enters state i, then, independently of all past states, the next state is j with probability 
P;;, for all states i and j. For many Markov chains, the probability of being in state j at 
time 1 converges to a limiting value that does not depend on the initial state. If we let 
7,j = 0,...,M, denote these limiting probabilities, then they are the unique solution 
of the equations 


M 
Gg= > Py F=0 sis 
i=0 


For an entropy interpretation of C*, see Theoretical Exercise 9.18. 
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Moreover, 7; is equal to the long-run proportion of time that the chain is in state j. 
Let X be a random variable that takes on one of n possible values according to the 


set of probabilities {p1,... 


, Pn}. The quantity 


H(X) = —} 3 pilog(pi) 


i=1 


is called the entropy of X. It can be interpreted as representing either the average 
amount of uncertainty that exists regarding the value of X or the average information 
received when X is observed. Entropy has important implications for binary codings 


of X. 


PROBLEMS AND THEORETICAL EXERCISES 


Customers arrive at a bank at a Poisson rate i. 

Suppose that two customers arrived during the first 

hour. What is the probability that 

(a) both arrived during the first 20 minutes? 

(b) at least one arrived during the first 20 min- 
utes? 


Cars cross a certain point in the highway in accor- 
dance with a Poisson process with rate 4 = 3 per 
minute. If Al runs blindly across the highway, what 
is the probability that he will be uninjured if the 
amount of time that it takes him to cross the road 
is s seconds? (Assume that if he is on the highway 
when a car passes by, then he will be injured.) Do 
this exercise for s = 2,5, 10,20. 


Suppose that in Problem 9.2 Al is agile enough to 
escape from a single car, but if he encounters two 
or more cars while attempting to cross the road, 
then he is injured. What is the probability that he 
will be unhurt if it takes him s seconds to cross? Do 
this exercise for s = 5, 10,20, 30. 


Suppose that 3 white and 3 black balls are dis- 
tributed in two urns in such a way that each urn 
contains 3 balls. We say that the system is in state 
iif the first urn contains i white balls, i = 0,1,2,3. 
At each stage, 1 ball is drawn from each urn and 
the ball drawn from the first urn is placed in the 
second, and conversely with the ball from the 
second urn. Let X, denote the state of the sys- 
tem after the mth stage, and compute the transition 
probabilities of the Markov chain {X;,,n = O}. 
Consider Example 2a. If there is a 50-50 chance of 
rain today, compute the probability that it will rain 
3 days from now if a = .7 and 6B = 3. 

Compute the limiting probabilities for the model 
of Problem 9.4. 

A transition probability matrix is said to be doubly 
stochastic if 


9.8. 


9.9, 


9.10. 


9.11. 


for all states 7 = 0,1,...,M. Show that such a 
Markov chain is ergodic, then I] =1/M+4+1),j= 
0,1,...,M. 

On any given day, Buffy is either cheerful (c), so-so 
(s), or gloomy (g). If she is cheerful today, then she 
will be c, s, or g tomorrow with respective probabil- 
ities .7, .2, and .1. If she is so-so today, then she will 
be c, s, or g tomorrow with respective probabilities 
4, .3, and .3. If she is gloomy today, then Buffy will 
be c, s, or g tomorrow with probabilities .2, .4, and 
.4. What proportion of time is Buffy cheerful? 


Suppose that whether it rains tomorrow depends 
on past weather conditions only through the last 
2 days. Specifically, suppose that if it has rained 
yesterday and today, then it will rain tomorrow 
with probability .8; if it rained yesterday but not 
today, then it will rain tomorrow with probability 
.3; if it rained today but not yesterday, then it will 
rain tomorrow with probability .4; and if it has not 
rained either yesterday or today, then it will rain 
tomorrow with probability .2. What proportion of 
days does it rain? 
A certain person goes for a run each morning. 
When he leaves his house for his run, he is equally 
likely to go out either the front or the back door, 
and similarly, when he returns, he is equally likely 
to go to either the front or the back door. The run- 
ner owns 5 pairs of running shoes, which he takes 
off after the run at whichever door he happens to 
be. If there are no shoes at the door from which he 
leaves to go running, he runs barefooted. We are 
interested in determining the proportion of time 
that he runs barefooted. 
(a) Set this problem up as a Markov chain. Give 
the states and the transition probabilities. 
(b) Determine the proportion of days that he runs 
barefooted. 
This problem refers to Example 2f. 
(a) Verify that the proposed value of [] j Satisfies 
the necessary equations. 
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9.14. 


9.15. 


9.16. 


9.1. 


9.2. 


9.3. 


Additional Topics in Probability 


(b) For any given molecule, what do you think is 
the (limiting) probability that it is in urn 1? 

(c) Do you think that the events that molecule /, 
j = 1, isin urn 1 at a very large time would be 
(in the limit) independent? 

(d) Explain why the limiting probabilities are as 
given. 

Determine the entropy of the sum that is obtained 

when a pair of fair dice is rolled. 

Prove that if X can take on any of possible values 

with respective probabilities P;,..., Py, then H(X) 

is maximized when P; = 1/n,i = 1,...,n. What is 

H(X) equal to in this case? 

A pair of fair dice is rolled. Let 


1 ifthe sum of the dice is 6 
x — . 
0 otherwise 


and let Y equal the value of the first die. Compute 
(a) H(Y), (b) Hy(X), and (c) H(X, Y). 

A coin having probability p = Z of coming up 
heads is flipped 6 times. Compute the entropy of 
the outcome of this experiment. 

A random variable can take on any of 1 possi- 


ble values x1,...,%, with respective probabilities 


9.17. 


9.18. 


p(xj),i = 1,...,n. We shall attempt to determine 
the value of X by asking a series of questions, 
each of which can be answered “yes” or “no.” For 
instance, we may ask “Is X = x;?” or “Is X equal 
to either x; or x2 or x3?” and so on. What can you 
say about the average number of such questions 
that you will need to ask to determine the value 
of X? 

Show that, for any discrete random variable X and 
function f, 

H(f(X)) = H(X) 


In transmitting a bit from location A to location 
B, if we let X denote the value of the bit sent at 
location A and Y denote the value received at loca- 
tion B, then H(X) — Hy(X) is called the rate of 
transmission of information from A to B. The max- 
imal rate of transmission, as a function of PLX¥ = 
1} = 1 — P{X = Of}, is called the channel capac- 
ity. Show that, for a binary symmetric channel with 
P{Y =1|X = 1} = P{Y = 0|X = 0} = p, the chan- 
nel capacity is attained by the rate of transmission 
of information when P{X = 1} = 4 and its value is 
1+ plogp + (1 — p)log( — p). 


SELF-TEST PROBLEMS AND EXERCISES 


Events occur according to a Poisson process with 

rate A = 3 per hour. 

(a) What is the probability that no events occur 
between times 8 and 10 in the morning? 

(b) What is the expected value of the number of 
events that occur between times 8 and 10 in 
the morning? 

(c) What is the expected time of occurrence of 
the fifth event after 2 P.M.? 

Customers arrive at a certain retail establishment 

according to a Poisson process with rate 4 per 

hour. Suppose that two customers arrive during 
the first hour. Find the probability that 

(a) both arrived in the first 20 minutes; 

(b) at least one arrived in the first 30 minutes. 

Four out of every five trucks on the road are fol- 

lowed by a car, while one out of every six cars is 

followed by a truck. What proportion of vehicles 
on the road are trucks? 
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A certain town’s weather is classified each day as 
being rainy, sunny, or overcast, but dry. If it is 
rainy one day, then it is equally likely to be either 
sunny or overcast the following day. If it is not 
rainy, then there is one chance in three that the 
weather will persist in whatever state it is in for 
another day, and if it does change, then it is equally 
likely to become either of the other two states. In 
the long run, what proportion of days are sunny? 
What proportion are rainy? 


Let X be a random variable that takes on 5 pos- 

sible values with respective probabilities .35, .2, .2, 

2, and .05. Also, let Y be a random variable that 

takes on 5 possible values with respective proba- 

bilities .05, .35, .1, .15, and .35. 

(a) Show that HX) > H(Y). 

(b) Using the result of Problem 9.13, give an intu- 
itive explanation for the preceding inequality. 
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How can we determine the probability of our winning a game of solitaire? 
(By solitaire, we mean any one of the standard solitaire games played with an ordi- 
nary deck of 52 playing cards and with some fixed playing strategy.) One possible 
approach is to start with the reasonable hypothesis that all (52)! possible arrange- 
ments of the deck of cards are equally likely to occur and then attempt to determine 
how many of these lead to a win. Unfortunately, there does not appear to be any sys- 
tematic method for determining the number of arrangements that lead to a win, and 
as (52)! is a rather large number and the only way to determine whether a particular 
arrangement leads to a win seems to be by playing the game out, it can be seen that 
this approach will not work. 

In fact, it might appear that the determination of the probability of winning at 
solitaire is mathematically intractable. However, all is not lost, for probability falls 
not only within the realm of mathematics, but also within the realm of applied sci- 
ence; and, as in all applied sciences, experimentation is a valuable technique. For our 
solitaire example, experimentation takes the form of playing a large number of such 
games or, better yet, programming a computer to do so. After playing, say, n games, 
if we let 

{0 if the ith game results in a win 
Xi = 
0 otherwise 


then X;,i = 1,...,n will be independent Bernoulli random variables for which 
E[X;] = P{win at solitaire} 


Hence, by the strong law of large numbers, we know that 


n 
2 Xj number of games won 
n 


: ~ number of games played 
l= 

will, with probability 1, converge to P{win at solitaire}. That is, by playing a large 
number of games, we can use the proportion of games won as an estimate of the prob- 
ability of winning. This method of empirically determining probabilities by means of 
experimentation is known as simulation. 
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In order to use a computer to initiate a simulation study, we must be able to gener- 
ate the value of a uniform (0, 1) random variable; such variates are called random 
numbers. To generate them, most computers have a built-in subroutine, called a 
random-number generator, whose output is a sequence of pseudorandom numbers— 
a sequence of numbers that is, for all practical purposes, indistinguishable from a sam- 
ple from the uniform (0, 1) distribution. Most random-number generators start with 
an initial value Xo, called the seed, and then recursively compute values by specifying 
positive integers a, c, and m, and then letting 


Xnii = (aX, + c)modulom n= 0 (1.1) 


where the foregoing means that aX, + c is divided by m and the remainder is taken 
as the value of X,,,1. Thus, each X,, is either 0,1,...,7 — 1, and the quantity X;,/m is 
taken as an approximation to a uniform (0, 1) random variable. It can be shown that, 
subject to suitable choices for a, c, and m, Equation (1.1) gives rise to a sequence of 
numbers that look as if they were generated from independent uniform (0, 1) random 
variables. 

As our starting point in simulation, we shall suppose that we can simulate from 
the uniform (0, 1) distribution, and we shall use the term random numbers to mean 
independent random variables from this distribution. 

In the solitaire example, we would need to program a computer to play out the 
game starting with a given ordering of the cards. However, since the initial order- 
ing is supposed to be equally likely to be any of the (52)! possible permutations, it 
is also necessary to be able to generate a random permutation. Using only random 
numbers, the following algorithm shows how this can be accomplished. The algorithm 
begins by randomly choosing one of the elements and then putting it in position 7; it 
then randomly chooses among the remaining elements and puts the choice in position 
n — 1, and so on. The algorithm efficiently makes a random choice among the remain- 
ing elements by keeping these elements in an ordered list and then randomly choosing 
a position on that list. 


EXAMPLE 1a Generating a random permutation 


Suppose we are interested in generating a permutation of the integers 1,2,..., such 
that all n! possible orderings are equally likely. Then, starting with any initial permu- 
tation, we will accomplish this after — 1 steps, where we interchange the positions 
of two of the numbers of the permutation at each step. Throughout, we will keep 
track of the permutation by letting X(i),i = 1,...,n denote the number currently in 
position i. The algorithm operates as follows: 


1. Consider any arbitrary permutation, and let X(i) denote the element in posi- 


tion i,i=1...,n. [For instance, we could take X(i) = i,i=1,...,n.] 
2. Generate a random variable N,, that is equally likely to equal any of the values 
i Lee T (2 


3. Interchange the values of X(N,,) and X(n). The value of X(n) will now remain 
fixed. [For instance, suppose that n = 4 and initially ¥@ = i,i = 1,2,3,4. If 
N4 = 3, then the new permutation is X(1) = 1,X(2) = 2,X(3) = 4,X(4 = 3, 
and element 3 will remain in position 4 throughout. ] 

4. Generate a random variable N,,_; that is equally likely to be either 1,2,..., 
n— 1. 

5. Interchange the values of X(N,_1) and X(n — 1). [If N3 = 1, then the new 
permutation is X(1) = 4, X(2) = 2,X(3) =1,X(4) =3.] 
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6. Generate N,_2, which is equally likely to be either 1,2,...,n — 2. 

7. Interchange the values of X(N,_2) and X(n — 2). [If No = 1, then the new 
permutation is X¥(1) = 2,X(2) = 4,X(3) = 1,X(4) = 3, and this is the final 
permutation. | 

8. Generate N,,-3, and so on. The algorithm continues until N2 is generated, and 
after the next interchange the resulting permutation is the final one. 


To implement this algorithm, it is necessary to be able to generate a random vari- 
able that is equally likely to be any of the values 1,2,...,4. To accomplish this, let 
U denote a random number—that is, U is uniformly distributed on (0, 1)—and note 
that kU is uniform on (0, k). Hence, 


1 
Pi-1<kU <i}= 7 i=1,...4k 


so if we take Nx = [kU] + 1, where [x] is the integer part of x (that is, the largest 
integer less than or equal to x), then Nx will have the desired distribution. 
The algorithm can now be succinctly written as follows: 


Step 1. Let X(1),...,X(n) be any permutation of 1,2,...,n. [For instance, we can 
set X(i) =i,i=1,...,n.] 

Step 2. Let/=n. 

Step 3. Generate a random number U and set N = [JU] + 1. 

Step 4. Interchange the values of X(N) and X(J). 

Step 5. Reduce the value of J by 1, and if J > 1, go to step 3. 

Step 6. X(1),...,X(m) is the desired random generated permutation. 


The foregoing algorithm for generating a random permutation is extremely useful. 
For instance, suppose that a statistician is developing an experiment to compare the 
effects of m different treatments on a set of n subjects. He decides to split the subjects 
into m different groups of respective sizes n1,2,...,Nm, where )°", nj = n, with 
the members of the ith group to receive treatment i. To eliminate any bias in the 
assignment of subjects to treatments (for instance, it would cloud the meaning of the 
experimental results if it turned out that all the “best” subjects had been put in the 
same group), it is imperative that the assignment of a subject to a given group be done 
“at random.” How is this to be accomplished?* 

A simple and efficient procedure is to arbitrarily number the subjects 1 through 
n and then generate a random permutation X(1),...,X(m) of 1,2,...,n. Now assign 
subjects X(1), X(2),...,X (m1) to be in group 1, X(m, + 1),...,X (m1, + m2) to be in 
group 2, and, in general, group j is to consist of subjects numbered X (nm, + nz + --- + 
nj} aA) de SS Upc ing lls | 


10.2 GENERAL TECHNIQUES FOR SIMULATING CONTINUOUS 
RANDOM VARIABLES 


In this section, we present two general methods for using random numbers to simulate 
continuous random variables. 


¥ Another technique for randomly dividing the subjects when m = 2 was presented in Exam- 
ple 2g of Chapter 6. The preceding procedure is faster, but requires more space than the one of 
Example 2g. 
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10.2.1 The Inverse Transformation Method 


A general method for simulating a random variable having a continuous distribution— 
called the inverse transformation method—is based on the following proposition. 


Proposition 2.1. Let U be a uniform (0, 1) random variable. For any continuous 
distribution function F, if we define the random variable Y by 


Y = F-1(U) 


then the random variable Y has distribution function F. [F~!(x) is defined to equal 
that value y for which F(y) = x.] 


Proof: 
Fy(a) = P{Y = a} 
= P{F-'(U) < a} (2.1) 


Now, since F(x) is a monotone function, it follows that F~!(U) < a if and only if 
U = F(a). Hence, from Equation (2.1), we have 


Fy(a) = P{UU = F(@)} 
= F(a) 


It follows from Proposition 2.1 that we can simulate a random variable X having 
a continuous distribution function F by generating a random number U and then 
setting X = FU). 
EXAMPLE 2a Simulating an exponential random variable 
If F(x) =1 — e-*, then F~!(u) is that value of x such that 


1—e*=u 
or 
x = —log(1 — u) 
Hence, if U is a uniform (0, 1) variable, then 
F-!(U) = —log(1 — U) 


is exponentially distributed with mean 1. Since 1 — U is also uniformly distributed on 
(0, 1), it follows that — log U is exponential with mean 1. Since cX is exponential with 
mean c when X is exponential with mean 1, it follows that —clog U is exponential 
with mean c. | 


The results of Example 2a can also be utilized to stimulate a gamma random 
variable. 


EXAMPLE 2b Simulating a gamma (n,)) random variable 


To simulate from a gamma distribution with parameters (n, 4) when n is an integer, 
we use the fact that the sum of m independent exponential random variables, each 
having rate i, has this distribution. Hence, if U;,...,U, are independent uniform 
(0, 1) random variables, then 
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has the desired distribution. | 


10.2.2 The Rejection Method 


Suppose that we have a method for simulating a random variable having density 
function g(x). We can use this method as the basis for simulating from the contin- 
uous distribution having density f(x) by simulating Y from g and then accepting the 
simulated value with a probability proportional to f(Y)/g(Y). 

Specifically, let c be a constant such that 


PO) =c forally 

&) 
We then have the following technique for simulating a random variable having 
density f. 
Rejection Method 


Step 1. Simulate Y having density g and simulate a random number U. 
Step 2. If U = f(Y)/cg(Y), set X = Y. Otherwise return to step 1. 


The rejection method is expressed pictorially in Figure 10.1. We now prove that it 


works. 
Start 
Yes 
Gennes Generate a Is > Set ¥-Y 
y~ t——>| random number p—>| UK< f(Y) 
g U ~ ¢g(Y) 


FIGURE 10.1: Rejection method for simulating a random variable X having density function f. 


Proposition 2.2. The random variable X generated by the rejection method has den- 
sity function f. 
Proof. Let X be the value obtained and let N denote the number of necessary 
iterations. Then 


PIX <x) =P{Yy =x 
7 Css 
=Ply has mal 
f(Y) 
cg(Y) 


Ply sx.U = 


K 


where K = P{U = f(Y)/cg(Y)}. Now, by independence, the joint density function 
of Y and U is 
fo.wW =gelty) O<u<1 
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so, using the foregoing, we have 
1 
PIX sx=_E l/ g(y) dudy 
ysx 


0 su = f(y)/cgy) 


1 eX  for/esy) 
=— i [ du g(y) dy 
—0o 


1 ae 
~ CK [s 0) dy (2.2) 


Letting X approach oo and using the fact that f is a density gives 


1 ee 1 
i=gl fow=z 


Hence, from Equation (2.2), we obtain 


ArSge / fy) dy 


which completes the proof. 


Remarks. (a) Note that the way in which we “accept the value Y with prob- 
ability f(Y)/cg(Y)” is by generating a random number U and then accepting Y if 
U <= f(Y)/cg(Y). 

(b) Since each iteration will independently result in an accepted value with proba- 
bility P({U = f(Y)/cg(Y)} = K = 1/c, it follows that the number of iterations has a 
geometric distribution with mean c. | 


EXAMPLE 2c Simulating a normal random variable 


To simulate a unit normal random variable Z (that is, one with mean 0 and variance 
1), note first that the absolute value of Z has probability density function 


el? Q<x <o (2.3) 


fe) = — 
4 — 
V2 
We will start by simulating from the preceding density function by using the rejection 
method, with g being the exponential density function with mean 1—that is, 


x 


g(x) =e" O< x <0 


Now, note that 


= exp | —@ = Db? | (2.4) 
Wu 2 
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Hence, we can take c = ,/2e/z; so, from Equation (2.4), 


FO) _ op | =D? 
cea) 2 


Therefore, using the rejection method, we can simulate the absolute value of a unit 
normal random variable as follows: 


(a) Generate independent random variables Y and U, Y being exponential with 
rate 1 and U being uniform on (0, 1). 


(b) If U < exp{—(Y — 1)*/2}, set X = Y. Otherwise, return to (a). 


Once we have simulated a random variable X having Equation (2.3) as its density 
function, we can then generate a unit normal random variable Z by letting Z be 
equally likely to be either XY or —X. 

In step (b), the value Y is accepted if U = exp{—(Y — 1)*/2}, which is equiva- 
lent to —log U = (Y — 1)?/2. However, in Example 2a it was shown that — log U is 
exponential with rate 1, so steps (a) and (b) are equivalent to 


(a’) Generate independent exponentials Y; and Y2, each with rate 1. 
(b’) If Y2 = (% - 1)*/2, set X = Y;. Otherwise, return to (a’). 


Suppose now that the foregoing results in Y;’s being accepted—so we know that Y2 
is larger than (Y; — 1)?/2. By how much does the one exceed the other? To answer 
this question, recall that Y2 is exponential with rate 1; hence, given that it exceeds 
some value, the amount by which Y2 exceeds (Y; — i? /2 [that is, its “additional 
life” beyond the time (Y; — 1)?/2] is (by the memoryless property) also exponentially 
distributed with rate 1. That is, when we accept step (b’), not only do we obtain X (the 
absolute value of a unit normal), but, by computing Y2 — (Y; — 1)? /2, we also can 
generate an exponential random variable (that is independent of X’) having rate 1. 

Summing up, then, we have the following algorithm that generates an exponential 
with rate 1 and an independent unit normal random variable: 


Step 1. Generate Y;, an exponential random variable with rate 1. 

Step 2. Generate Y2, an exponential random variable with rate 1. 

Step 3. If Yo -— (Y; - 1)*/2 > 0,set Y = Yo — (Y; — 1)*/2 and go to step 4. 
Otherwise, go to step 1. 

Step 4. Generate a random number U, and set 


Y, if Us 
~ |-¥, if U> 


Nie NI 


The random variables Z and Y generated by the foregoing algorithm are indepen- 
dent, with Z being normal with mean 0 and variance 1 and Y being exponential with 
rate 1. (If we want the normal random variable to have mean jz and variance o”, we 


just take w + oZ.) 


Remarks. (a) Since c = /2e/m ~ 1.32, the algorithm requires a geometrically 
distributed number of iterations of step 2 with mean 1.32. 

(b) If we want to generate a sequence of unit normal random variables, then we can 
use the exponential random variable Y obtained in step 3 as the initial exponential 
needed in step 1 for the next normal to be generated. Hence, on the average, we 
can simulate a unit normal by generating 1.64(= 2 X 1.32 — 1) exponentials and 
computing 1.32 squares. | 
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EXAMPLE 2d Simulating normal random variables: the polar method 


It was shown in Example 7b of Chapter 6 that if X¥ and Y are independent unit normal 


random variables, then their polar coordinates R = /X2 + Y?,0 = tan—!(Y/X) 
are independent, with R* being exponentially distributed with mean 2 and © being 
uniformly distributed on (0,27). Hence, if U; and U2 are random numbers, then, 
using the result of Example 2a, we can set 


R = (-2log U,)! 
O =2n U, 


from which it follows that 
X = Rcos 0 = (—2 log U;)'/? cos(27 U2) 
Y = Rsin@ = (—2log U,)!” sin(2x U2) (2.5) 


are independent unit normals. a 


The preceding approach to generating unit normal random variables is called the 
Box-—Muller approach. Its efficiency suffers somewhat from its need to compute the 
sine and cosine values. There is, however, a way to get around this potentially time- 
consuming difficulty. To begin, note that if U is uniform on (0, 1) then 2U is uniform 
on (0, 2),so 2U — 1 is uniform on (—1,1). Thus, if we generate random numbers U;, 
and U2 and set 


= = 1 
VW S0 = 1 


then (V1, V2) is uniformly distributed in the square of area 4 centered at (0, 0). (See 
Figure 10.2.) 

Suppose now that we continually generate such pairs (V;, V2) until we obtain one 
that is contained in the disk of radius 1 centered at (0, 0)—that is, until Ve + V5 = 1, 
It then follows that such a pair (V1, V2) is uniformly distributed in the disk. Now, let 


(-1, 1) (1, 1) 
Vi+V5=1 
(-1, -1) (1, -1) 
e = (0,0) 
x =(V;, Vo) 


FIGURE 10.2: 
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R, © denote the polar coordinates of this pair. Then it is easy to verify that R and © 


are independent, with R being uniformly distributed on (0, 1) and © being uniformly 
distributed on (0,277). (See Problem 13.) 


Since 
sin ® = a = V2 
2 2 
(V2 + V3 
cos ® = 7 = 4 
2 2 
a Vit V3 


it follows from Equation (2.5) that we can generate independent unit normals X and 
Y by generating another random number U and setting 


X = (—2log U)'/V,/R 
Y = (—2log U)'/*V2/R 


ss = . ; a 
In fact, because (conditional on Vi + Ve = 1) RF is uniform on (0, 1) and is inde- 
pendent of 6, we can use it instead of generating a new random number U, thus 


showing that 
X = (—2logR — = Vv 
(—2logR ) ries ae 1 
52, 1/2 V2 —2logS 
Y = (—2logR = ‘s 
(—2log R ) ia - 


are independent unit normals, where 


S=R=V2+V2 


Summing up, we have the following approach to generating a pair of independent 
unit normals: 


Step 1. Generate random numbers U, and U2. 

Step 2. Set Vj = 2U, — 1,V2=2U2 — 1,S=Vi + V3. 
Step 3. IfS > 1, return to step 1. 

Step 4. Return the independent unit normals 


—2logS —2logS 
X= VY44Y= V. 
a i a mas 


The preceding algorithm is called the polar method. Since the probability that a 
random point in the square will fall within the circle is equal to 2/4 (the area of the 
circle divided by the area of the square), it follows that, on average, the polar method 
will require 4/2 ~ 1.273 iterations of step 1. Hence, it will, on average, require 2.546 
random numbers, 1 logarithm, 1 square root, 1 division, and 4.546 multiplications to 
generate 2 independent unit normals. 


EXAMPLE 2e Simulating a chi-squared random variable 


The chi-squared distribution with n degrees of freedom is the distribution of x7 = 
Zz ftoeee + ZL. where Z;,i = 1,...,m are independent unit normals. Now, it was 
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shown in Section 6.3 of Chapter 6 that Z + Za has an exponential distribution with 
rate 7 Hence, when nv is even (say, n = 2k), Xo has a gamma distribution with param- 
eters (, 3). Thus, —2log(T]|K, U;) has a chi-squared distribution with 2k degrees 


of freedom. Accordingly, can simulate a chi-squared random variable with 2k + 1 
degrees of freedom by first simulating a unit normal random variable Z and then 
adding Z? to the foregoing. That is, 


k 
Xp = Z — 2log | [ [Ui 
i=1 


where Z, Uj,..., U, are independent, Z is a unit normal, and Uj,..., U, are uniform 
(0, 1) random variables. 


10.3 SIMULATING FROM DISCRETE DISTRIBUTIONS 


All of the general methods for simulating random variables from continuous distribu- 
tions have analogs in the discrete case. For instance, if we want to simulate a random 
variable Z having probability mass function 


Mca F.. f=O a, \ Pad 
j 


we can use the following discrete time analog of the inverse transform technique: 
To simulate X for which P(X = x;} = P;, let U be uniformly distributed over (0, 1) 


and set 
x1 ifU s P, 
x» fPy < USP} +P 
X= j-1 J 
S ty PSUS YP; 
1 i 
Since 


j-l j 
xagja PP) Pes) PSP, 
1 1 


it follows that X has the desired distribution. 


EXAMPLE 3a The geometric distribution 


Suppose that independent trials, each of which results in a “success” with probability 
p,0 < p < 1, are continually performed until a success occurs. Letting X denote the 
necessary number of trials; then 


P{X =i}=(1 — p)'p i=1 
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which is seen by noting that XY = iif the first i — 1 trials are all failures and the ith 
trial is a success. The random variable X is said to be a geometric random variable 
with parameter p. Since 


j-1 

So P(X =i =1- P(X >j- Vy 

i=l 
=1 — Pi{first 7 — 1 are all failures} 
=(=—@=py? f21 


we can simulate such a random variable by generating a random number U and then 
setting X equal to that value j for which 


1=WM=py" 2721] = py 
or, equivalently, for which 
CepelaUe tp) 
Since 1 — U has the same distribution as U, we can define X by 
X =min{j:(1 — py < U} 


= min{j:jlog(1 — p) = log U} 


=minij:j;= el 
I Tos — p) 


where the inequality has changed sign because log(1 — p) is negative [since log(1 — 
p) < log1 = Oj]. Using the notation [x] for the integer part of x (that is, [x] is the 
largest integer less than or equal to x), we can write 


As in the continuous case, special simulating techniques have been developed for 
the more common discrete distributions. We now present two of these. 


EXAMPLE 3b Simulating a binomial random variable 


A binomial (n, p) random variable can easily be simulated by recalling that it can 
be expressed as the sum of m independent Bernoulli random variables. That is, if 
U;,..., U, are independent uniform (0, 1) variables, then letting 


jb Bop p 
a i otherwise 


n 
it follows that X = )° Xj is a binomial random variable with parameters n and p. 
i=l 
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EXAMPLE 3c Simulating a Poisson random variable 


To simulate a Poisson random variable with mean A, generate independent uniform 
(0, 1) random variables Uj, U2,... stopping at 


n 
N = min n:] [U; ce 
i=l 


The random variable X = N — 1 has the desired distribution. That is, if we continue 
generating random numbers until their product falls below e~*, then the number 
required, minus 1, is Poisson with mean i. 

That X = N — 1is indeed a Poisson random variable having mean A can perhaps 
be most easily seen by noting that 


n 
X +1=min n:| [U; <e* 
i=1 


is equivalent to 


n 0 
X = max {7n: Ue where I] U; =1 
i=1 i=l 


or, taking logarithms, to 


X = max n: ) log U; = —) 
i=1 


or 
n 


X = max n: )° —log U; =A 
i=1 


However, — log U; is exponential with rate 1, so X can be thought of as being the 
maximum number of exponentials having rate 1 that can be summed and still be less 
than 4. But by recalling that the times between successive events of a Poisson process 
having rate 1 are independent exponentials with rate 1, it follows that X is equal to the 
number of events by time 4 of a Poisson process having rate 1; thus X has a Poisson 
distribution with mean A. | 


10.4 VARIANCE REDUCTION TECHNIQUES 
Let X1,...,X, have a given joint distribution, and suppose that we are interested in 
computing 
6 = Elg(X%,...,Xn)] 


where g is some specified function. It sometimes turns out that it is extremely difficult 
to analytically compute 6, and when such is the case, we can attempt to use simulation 


to estimate 6. This is done as follows: Generate X. - pak x having the same joint 
distribution as _X1,...,X, and set 


Y, = g(X)”,...,X) 
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Now let X. C aks Xo simulate a second set of random variables (independent of the 
first set) having the distribution of X1,...,X;, and set 


2 
Yo = 9(X\”,...,X@) 
Continue this until you have generated k (some predetermined number) sets and so 
have also computed Yj, Y2,..., Yz. Now, Y1,..., Y; are independent and identically 
distributed random variables, each having the same distribution as g(X1,...,Xn). 
Thus, if we let Y denote the average of these k random variables—that is, if 


k 
Y=>> 


i 


>| X 


then 
E[Y]=0 
E((Y — 6)7] = Var(Y) 

Hence, we can use Y as an estimate of 6. Since the expected square of the difference 
between Y and @ is equal to the variance of Y, we would like this quantity to be as 
small as possible. [In the preceding situation, Var(Y) = Var(Y;)/k, which is usually 
not known in advance, but must be estimated from the generated values Y1,..., Yn.] 
We now present three general techniques for reducing the variance of our estimator. 
10.4.1 Use of Antithetic Variables 


In the foregoing situation, suppose that we have generated Y, and Y2, which are 
identically distributed random variables having mean 6. Now, 


Var (==) 7 slvar() + Var(¥2) + 2Cov(¥1, ¥2)] 


_ Var(¥1) Cov(Y1, Y2) 

i ae 2 
Hence, it would be advantageous (in the sense that the variance would be reduced) 
if Y; and Y> were negatively correlated rather than being independent. To see how 
we could arrange this, let us suppose that the random variables X1,...,X, are inde- 
pendent and, in addition, that each is simulated via the inverse transform technique. 
That is, X; is simulated from F; lu), where Uj; is a random number and F; is the 
distribution of X;. Thus, Y; can be expressed as 


Yi = 9(F, | (W1),.-., Fa (Un) 


Now, since 1 — U is also uniform over (0, 1) whenever U is a random number (and 
is negatively correlated with U), it follows that Y defined by 


Y¥2 =g(F, ‘(1 — Uj),...,F,'( — Un)) 


will have the same distribution as Y;. Hence, if Y; and Y2 were negatively correlated, 
then generating Y2 by this means would lead to a smaller variance than if it were 
generated by a new set of random numbers. (In addition, there is a computational 
savings because, rather than having to generate n additional random numbers, we 
need only subtract each of the previous n numbers from 1.) Although we cannot, in 
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general, be certain that Y; and Y2 will be negatively correlated, this often turns out to 
be the case, and indeed it can be proven that it will be so whenever g is a monotonic 
function. 


10.4.2 Variance Reduction by Conditioning 


Let us start by recalling the conditional variance formula (see Section 7.5.4) 
Var(Y) = E[Var(Y|Z)] + Var(E[Y|Z]) 


Now, suppose that we are interested in estimating E[g(X1,...,X,)] by simulating 
X = (Xj,...,X,) and then computing Y = g(X). If, for some random variable Z 
we can compute E[Y|Z], then, since Var(Y|Z) = 0, it follows from the preceding 
conditional variance formula that 


Var(E[Y|Z]) = Var(Y) 


Thus, since E[E[Y|Z]] = E[Y], it follows that E[Y|Z] is a better estimator of E[Y] 
than is Y. 


EXAMPLE 4a Estimation of x 


Let U; and U2 be random numbers and set V; = 2U; — 1,i = 1,2. As noted in 
Example 2d,(V1, V2) will be uniformly distributed in the square of area 4 centered at 
(0, 0). The probability that this point will fall within the inscribed circle of radius 1 
centered at (0, 0) (see Figure 10.2) is equal to 2/4 (the ratio of the area of the circle 
to that of the square). Hence, upon simulating a large number n of such pairs and 
setting 

— {0 if the jth pair falls within the circle 

i~)0 otherwise 


it follows that J;,j = 1,...,n, will be independent and identically distributed random 
variables having E[J;] = 2/4. Thus, by the strong law of large numbers, 


K+: +h eu 
n 4 


Therefore, by simulating a large number of pairs (V;, V2) and multiplying the propor- 
tion of them that fall within the circle by 4, we can accurately approximate z. 

The preceding estimator can, however, be improved upon by using conditional 
expectation. If we let J be the indicator variable for the pair (V;, V2), then, rather 
than using the observed value of /, it is better to condition on V, and so utilize 


as N—-Co 


EV] = P(Vi + V3 = 11Vi} 
= P{V? <1 — V2|Vi} 


Now, 

PIV3 <1 — ViVi =v} = P{VZ = 1 — v?} 
=P{-V1— v2 =v) <= v1 - vy 
fi — 

so 


EU\Vij=/1 - Vi 
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Thus, an improvement on using the average value of J to estimate 7/4 is to use the 


average value of ,/1 — ve Indeed, since 


Bl fh va= fi vi = Rav= [vi — wdu= E[V1 — U?] 


where U is uniform over (0, 1), we can generate n random numbers U and use the 
average value of 1 — U? as our estimate of 7/4. (Problem 14 shows that this esti- 
mator has the same variance as the average of the n values, /1 — V2.) 

The preceding estimator of z can be improved even further by noting that the 
function g(u) = /1 — u2,0 S u S 1, is a monotonically decreasing function of u, 
and so the method of antithetic variables will reduce the variance of the estimator 
of E[V¥1 — U?]. That is, rather than generating n random numbers and using the 
average value of 1 — U? as an estimator of 7/4, we would obtain an improved 
estimator by generating only n/2 random numbers U and then using one-half the 
average of /1 — U2 + V1 — (1 — U)* as the estimator of 1/4. 

The following table gives the estimates of z resulting from simulations, using 1 = 
10, 000, based on the three estimators. 


Method Estimate of zr 


Proportion of the random points that fall in the circle 3.1612 
Average value of ¥1 — U2 3.128448 


Average value of /1 — U2 + 1 — (1 — U)* 3.139578 


A further simulation using the final approach and n = 64,000 yielded the estimate 
3.143288. i 


10.4.3 Control Variates 


Again, suppose that we want to use simulation to estimate E[g(X)], where X = 
(X1,..., Xn). But suppose now that, for some function f, the expected value of f(X) 
is known—say, it is E[f(X)] = «. Then, for any constant a, we can also use 


W = g(X) + alf(X) — ul] 
as an estimator of E[g(X)]. Now, 
Var(W) = Var[g(X)] + a’Var[f(X)] + 2a Cov[g(X), f(X)] (4.1) 
Simple calculus shows that the foregoing is minimized when 


_ —Cov[f(X), g(X)] 
Var fC] 


(4.2) 


and for this value of a, 


[Cov[f(X), g(X)]? 
Var[f(X)] 


Var(W) = Var[g(X)] (4.3) 
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Unfortunately, neither Var[f(X)] nor Cov[f(X)], gCX)] is usually known, so we can- 
not in general obtain the foregoing reduction in variance. One approach in practice 
is to use the simulated data to estimate these quantities. This approach usually yields 
almost all of the theoretically possible reduction in variance. 


SUMMARY 


Let F be a continuous distribution function and U a uniform (0, 1) random variable. 
Then the random variable F~!(U) has distribution function F, where F~!(u) is that 
value x such that F(x) = u. Applying this result, we can use the values of uniform (0, 
1) random variables, called random numbers, to generate the values of other random 
variables. This technique is called the inverse transform method. 

Another technique for generating random variables is based on the rejection method. 
Suppose that we have an efficient procedure for generating a random variable from 
the density function g and that we desire to generate a random variable having den- 
sity function f. The rejection method for accomplishing this starts by determining a 
constant c such that 


It then proceeds as follows: 


1. Generate Y having density g. 

2. Generate a random number U. 

3. IfU = f(Y)/cg(Y), set X = Y and stop. 
4. Return to step 1. 


The number of passes through step 1 is a geometric random variable with mean c. 

Standard normal random variables can be efficiently simulated by the rejection 
method (with g being exponential with mean 1) or by the technique known as the 
polar algorithm. 

To estimate a quantity 0, one often generates the values of a partial sequence 
of random variables whose expected value is 0. The efficiency of this approach is 
increased when these random variables have a small variance. Three techniques that 
can often be used to specify random variables with mean @ and relatively small vari- 
ances are 


1. the use of antithetic variables, 
2. the use of conditional expectations, and 
3. the use of control variates. 


PROBLEMS 
10.1. The following algorithm will generate a random Step 4. Generate a random number U and let 
permutation of the elements 1,2,...,7. It is some- _ 
what faster than the one presented in Example la PR) = PURO | se 1) 
but is such that no position is fixed until the algo- P((kU] + =k 
rithm ends. In this algorithm, P(z) can be inter- 
preted as the element in position i. Go to step 3. : ae 
(a) Explain in words what the algorithm is doing. 
Step 1. Setk=1. (b) Show that at iteration k—that is, when the 
Step 2. Set P(1) = 1. value of P(k) is initially set—P(1), P(2),..., 


Step 3. If k =n, stop. Otherwise, letk =k + 1. P(k) is arandom permutation of 1,2,...,k. 
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10.2. 


10.3. 


10.4. 


10.5. 


10.6. 


10.7. 
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Hint: Use induction and argue that 


Prit, i2,--- 547-1, Kj, ---,tk-25 0 


= Pr_ifit,i2,.--,i-1,4,1j,---,tk-2} 


aR 


1 
=a by the induction hypothesis 


Develop a technique for simulating a random vari- 
able having density function 


2x 
f(x) = {e, 


Give a technique for simulating a random variable 
having the probability density function 


—oo < x < 0 
0<x <o 


5-2) 2sxs3 
FQ) = 5(2 - 5) 3<x<6 
0 otherwise 


Present a method for simulating a random variable 
having distribution function 


0 x= -3 

1 

a —3 <x <0 
F(x) = ; 

ae O0O<xs4 

2 3 ~ 

1 x>4 


Use the inverse transformation method to present 
an approach for generating a random variable 
from the Weibull distribution 


F®j)=1-e% 120 


Give a method for simulating a random variable 
having failure rate function 

(a) AD =c; 

(b) A(t) = ct; 

(c) AD = ct; 

(d) A(t) = ct. 

Let F be the distribution function 


F(xyy=x"” O<x<1 

(a) Give a method for simulating a random vari- 
able having distribution F that uses only a sin- 
gle random number. 

(b) Let U,,...,U, be independent random num- 
bers. Show that 


P{max(Uj,...,Un) = x} = x” 


10.8. 


10.9. 


10.10. 


10.11. 


10.12. 


10.13. 


10.14. 


(c) Use part (b) to give a second method of sim- 
ulating a random variable having distribu- 
tion F. 


Suppose it is relatively easy to simulate from F; for 
eachi=1,...,n. How can we simulate from 
n 
(a) F(x) = [| Fi@)? 
i=1 
n 


(b) F@)=1- [fl - Aw) 

i— 
Suppose we have a method for simulating random 
variables from the distributions F, and F>. Explain 
how to simulate from the distribution 


F(x) = pFi(x) + (1 — p)Fo(x) 0O<p<1 


Give a method for simulating from 


pid x1 — e*) + 3x 0O<x=1 
(x) = La — etry 4 2 
3 3 


x>1 


In Example 2c we simulated the absolute value 
of a unit normal by using the rejection procedure 
on exponential random variables with rate 1. This 
raises the question of whether we could obtain a 
more efficient algorithm by using a different expo- 
nential density—that is, we could use the density 
g(x) = Ae~**. Show that the mean number of iter- 
ations needed in the rejection scheme is minimized 
when d = 1. 


Use the rejection method with g(x) = 1,0 <x <1, 
to determine an algorithm for simulating a random 
variable having density function 


34. aD 
peo = | d—x) 


Explain how you could use random numbers to 
approximate 5 k(x) dx, where k(x) is an arbitrary 
function. 

Hint: If U is uniform on (0, 1), what is E[k(U)]? 
Let (X,Y) be uniformly distributed in the circle 
of radius 1 centered at the origin. Its joint density 
is thus 


Ox = 1 
otherwise 


1 
y=-— 0=< x 2=] 
fay +y 
IU 


Let R = (X? + Y?)!/2 andé = tan“!(Y/X) denote 
the polar coordinates of (X, Y). Show that R and 
6 are independent, with R? being uniform on (0, 1) 
and 6 being uniform on (0,277). 


In Example 4a, we showed that 


E(a — v2)¥?] = Efa — v?y/?] = sf 


10.15. 


10.1. 


10.2. 


10.3. 


when V is uniform (—1,1) and U is uniform (0, 1). 
Now show that 


Var[(1 — V?)!/?] = Var[( — U?)!/?] 


and find their common value. 


(a) Verify that the minimum of (4.1) occurs when 
ais as given by (4.2). 


10.16. 
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(b) Verify that the minimum of (4.1) is given by 
(4.3). 

Let X be a random variable on (0, 1) whose den- 
sity is f(x). Show that we can estimate is g(x) dx 
by simulating X and then taking g(X)/f(X) as 
our estimate. This method, called importance sam- 
pling, tries to choose f similar in shape to g, so that 
g(X)/f(X) has a small variance. 


SELF-TEST PROBLEMS AND EXERCISES 


The random variable X has probability density 
function 
O<x<1 


f(x) = Ce* 


(a) Find the value of the constant C. 

(b) Give a method for simulating such a random 
variable. 

Give an approach for simulating a random variable 

having probability density function 


fe) =30@? — 23 +x4) O<x<1 


Give an efficient algorithm to simulate the value of 
a random variable with probability mass function 


REFERENCE 


Pi = 15 p2= .2 p3 = 35 p4 = 30 


10.4. If X is a normal random variable with mean ju 


10.5. 


and variance o”, define a random variable Y that 
has the same distribution as X and is negatively 
correlated with it. 


Let X and Y be independent exponential random 

variables with mean 1. 

(a) Explain how we could use simulation to esti- 
mate E[e*” ]. 

(b) Show how to improve the estimation 
approach in part (a) by using a control variate. 


[1] Ross, S. M. Simulation. 4th ed. San Diego: Academic Press, Inc., 2006. 
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1. 67,600,000; 19,656,000 2.1296 4.24;4 5.144;18 6.2401 7. 720; 72; 144; 
72 8. 120; 1260; 34,650 9. 27,720 10. 40,320; 10,080; 1152; 2880; 384 11. 720; 
72;144 12. 24,300,000; 17,100,720 13.190 14. 2,598,960 16. 42; 94 

17. 604,800 18.600 19. 896; 1000;910 20. 36;26 21.35 22.18 23. 48 
25. 52!/(13!)* 27. 27,720 28. 65,536; 2520 29. 12,600;945 30. 564,480 

31. 165;35 32. 1287;14,112 33. 220; 572 


CHAPTER 2 


9.74 10..4;.1 11. 70;2 12. .5;.32; 149/198 13. 20,000; 12,000; 11,000; 68,000; 
10,000 14. 1.057 15. .0020; .4226; .0475; .0211; .00024 17. 9.10947 x 10~® 

18. .048 =19.5/18 20. .9052 22. (n + 1)/2" 23.5/12  25..4 26. .492929 
27. .0888; .2477; .1243; .2099 30. 1/18; 1/6; 1/2 31. 2/9; 1/9 = 33. 70/323 

36. .0045; .0588 37. .0833;.5 38.4 39. .48 40. 1/64; 21/64; 36/64; 6/64 
41.5177 44. .3;.2;.1 46.5 48. 1.0604 x 10-3 49, .4329 50. 2.6084 x 10~° 
52. .09145; .4268 53.12/35 54. .0511 55. .2198; .0343 


CHAPTER 3 


1. 1/3 

2. 1/6; 1/5; 1/4; 1/3; 1/2;1 3. .339 5.6/91 6.1/2 7. 2/3 

8.1/2 9. 7/11 10. .22 11. 1/17;1/33 12. .504;.3629 14. 35/768; 210/768 

15. .4848 16. .9835 17. .0792; .264 18. .331; .383; .286; 48.62 19. 44.29; 
41.18 20. .4;1/26 21. .496;3/14;9/62 22. 5/9;1/6;5/54 23. 4/9;1/2 24. 1/3; 
1/2 26. 20/21; 40/41 28. 3/128; 29/1536 29. .0893 30. 7/12;3/5 33. .76, 
49/76 34.27/31 35. .62,10/19 36.1/2 37. 1/3;1/5;1 38.12/37 39. 46/185 
40. 3/13; 5/13; 5/52; 15/52. 41. 43/459 42.34.48 43.4/9 45.1/11 48. 2/3 

50. 17.5; 38/165; 17/33 51. .65; 56/65; 8/65; 1/65; 14/35; 12/35; 9/35 52. .11; 16/89; 
12/27; 3/5;9/25 55.9 57. (c)2/3 60. 2/3; 1/3;3/4 61. 1/6;3/20 65. 9/13; 

1/2 69. 9; 9; 18; 110; 4; 4; 8; 120 all over 128 70. 1/9;1/18 71. 38/64; 13/64; 13/64 
73. 1/16; 1/32; 5/16; 1/4; 31/32 74.9/19 75. 3/4,7/12 78. p?/(1 — 2p + 2p) 
79. 5550 81. .9530 = 83. 5; .6;.8 84. 9/19; 6/19; 4/19; 7/15; 53/165; 7/33 

89. 97/142; 15/26; 33/102 


CHAPTER 4 


1. p(4) = 6/91; p(2) = 8/91; p(1) = 32/91; pO) = 1/91; p(—1) = 16/91; 
p(—2) = 28/91 4. (a) 1/2: 5/18; 5/36; 5/84; 5/252; 1/252; 0;0;0;0 5.n — 2i: 
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i=0,...,n 6. p(3) = p(—3) = 1/8; pd) = p(-1) = 3/812. p(4) = 1/16; 

p(3) = 1/8; p(2) = 1/16; p(0) = 1/2; p(-) = p@; pO) = 1 13. pO) = ..28; 
p(500) = .27, p(1000) = .315; p(1500) = .09; p(2000) = .045. 14. p(0) = 1/2; 
p(1) = 1/6; p(2) = 1/12; p(3) = 1/20; p(4) = 1/5 17. 1/4; 1/6; 1/12; 1/2 19. 1/2; 
1/10; 1/5; 1/10; 1/10 20. .5918; no; —.108 21. 39.28;37 24. p = 11/18; 
maximum = 23/72 25. .46,1.3. 26. 11/2;17/5 27. A(p + 1/10) 28. 3/5 
31. p* 32.11 — 10(.9)!9 33.3 35. —.067:1.089 37. 82.2;84.5 39. 3/8 
40. 11/243 42.p=1/2 45.3 50.1/10;1/10 51. e~?;1 — 1.2e~?7 

53.1 — e 81 — e719-18 56,253 57. 5768; .6070 59. .3935; .3033; .0902 
60. .8886 61. .4082 63. .0821; .2424 65. .3935; .2293; 3935 66. 2/(2n — 1); 
2/(2n — 2);e-! 67. 2/n; (2n — 3)/(n — 1)2;e-2 68. e108 

70.p + (1 — pye*! = 71. 1500; .1012 73. 5.8125 74. 32/243; 4864/6561; 
160/729; 160/729 78. 18(17)"-1/(35)"_ 81. 3/10; 5/6; 75/138 

82. 3439 83. 1.5 


CHAPTER 5 


2.3.5e°9/2, 3.no:no 4.1/2 5.1 —(.01)!5 6.4,0,0 7. 3/5;6/5 8.2 
10. 2/3;2/3 1.2/5 13. 2/3;1/3 15. .7977; .6827; .3695; .9522; .1587 

16. (.9938)!9 18.22.66 19.14.56 20. .9994;.75;.977 22. 9.5; .0019 

23. 9258; .1762 26. .0606;.0525 28. .8363 29. .9993 32. e!:e 1/2 
34.e71;1/3  38.3/5 40. 1/y 


CHAPTER 6 


2. (a) 14/39; 10/39; 10/39; 5/39 (b) 84; 70; 70; 70; 40; 40; 40; 15 all divided by 429 

3. 15/26; 5/26; 5/26; 1/26 4, 25/169; 40/169; 40/169; 64/169 7. p(i,j) = p21 — p)it! 
8.c = 1/8; E[X]=0 9. (12x? + 6x)/7; 15/56; 8625; 5/7;8/7 10.1/2;1 — e~4 
11. 1458 12. 39.3e-9 13. 1/6; 1/2 15.2/4 16. n(1/2)""! 17.1/3 18. 7/9 
19. 1/2 21. 2/5;2/5 22. no; 1/3 23. 1/2; 2/3; 1/20;1/18 25.e1/i! 28. Se 
1-3e-? 29. .0326 30. .3772; .2061 31. .0829; 3766 32.e-7;1 — 3e? 

35. 5/13; 8/13 36. 1/6; 5/6; 1/4; 3/4 41. (y + 1)2xe7*O+); xe; e-* 

42. 1/2 + 3y/(4x) — y3/(4e) 46.1 = 2a/Ly? 47..79297 48.1 — e>"4; 

(1 —e 4) 52.r/1 53.r 56. (a)u/(v + 1)? 


CHAPTER 7 


1. 52.5/12 2. 324;199.6 3.1/2;1/4;0 4. 1/6;1/4;1/2 5.3/2 6.35 7. .9; 4.9; 
42 8(1—-(-—p)%)/p 10..6;0 11.2 — 1)pd — p) 

12. (3n? — n)/(4n — 2),3n?/(4n — 2) 14.m/(1 — p) 15.1/2 18.4 

21. .9301; 87.5755 22.14.7 23.147/110  26.n/(n + 1);1/( + 1) 29. Be; 12; 
4; 23 31.175/6 33.14 34, 20/19; 360/361 35. 21.2; 18.929; 49.214 

36. —n/36 37.0 38.1/8 41. 6;112/33 42. 100/19; 16,200/6137; 10/19; 
3240/6137 45.1/2;0 47.1/(n — 1) 48. 6;7;5.8192 49. 6.06 50. 2y” 
51.y°/4 53.12 54.8 56.N(1 — e!9/N) 57.12.5 63. —96/145 65. 5.16 
66.218 67. x{1 + (2p — 1)?}" 69. 1/2; 1/16; 2/81 70. 1/2, 1/3 

72. 1/i; [iG + 1)]}-!;00 73. w3 1 + 07; yes; 0? 

79. 176; 141 
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CHAPTER 8 


1. 219/20 2. 15/17; =3/4;=10 3.23 4. <4/3;.8428 5..1416 6. .9431 
7. 3085 8. .6932 9. (327) 10.117 11. =.057 13. .0162; .0003; 
2514; .2514 14.n = 23 16. .013; .018;.691 18.=2 23. .769; .357; 
4267; .1093; .112184 


CHAPTER 9 


1. 1/9; 5/9 3. 9735; .9098; .7358; .5578 10. (b) 1/6 = 14. 2.585; .5417; 3.1267 
15. 5.5098 
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Solutions to Self-Test Problems and 


Exercises 


CHAPTER 1 
1.1. (a) There are 4! different orderings of the letters C, D, E, F. For each of these 


1.2. 


1.3. 


(b) 
(c) 


(d) 


(e) 


(f) 


orderings, we can obtain an ordering with A and B next to each other by 
inserting A and B, either in the order A, B or in the order B, A, in any 
of 5 places, namely, either before the first letter of the permutation of 
C, D, E, F, or between the first and second, and so on. Hence, there are 
2-5 - 4! = 240 arrangements. Another way of solving this problem is 
to imagine that B is glued to the back of A. Then there are 5! orderings 
in which A is immediately before B. Since there are also 5! orderings in 
which B is immediately before A, we again obtain a total of 2 - 5! = 240 
different arrangements. 

There are 6! = 720 possible arrangements, and since there are as many 
with A before B as with B before A, there are 360 arrangements. 

Of the 720 possible arrangements, there are as many that have A before 
B before C as have any of the 3! possible orderings of A, B, and C. Hence, 
there are 720/6 = 120 possible orderings. 

Of the 360 arrangements that have A before B, half will have C before D 
and half D before C. Hence, there are 180 arrangements having A before 
B and C before D. 

Gluing B to the back of A and D to the back of C yields 4! = 24 different 
orderings in which B immediately follows A and D immediately follows 
C. Since the order of A and B and of C and D can be reversed, there are 
4 . 24 = 96 different arrangements. 

There are 5! orderings in which E is last. Hence, there are 6! — 5! = 600 
orderings in which E is not last. 


3! 4! 3! 3!, since there are 3! possible orderings of countries and then the coun- 
trymen must be ordered. 


(a) 
(b) 


(c) 
(d) 
(e) 


10-9 -8=720 

8-7-6+4+2-3.-8.-7= 672. The result of part (b) follows because 
there are 8 - 7 - 6 choices not including A or B and there are3 - 8 - 7 
choices in which a specified one of A and B, but not the other, serves. The 
latter follows because the serving member of the pair can be assigned to 
any of the 3 offices, the next position can then be filled by any of the other 
8 people, and the final position by any of the remaining 7. 
8-7-64+3-2.-8=384. 

3-9-8=216. 

9-8-7+4+9.8=576. 
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1.4. 


15. 


1.6. 


1.7. 


18. 


1.9. 


1.10. 


1.11. 


% @ 


» 3G) +O) + OQ) 
OO aa 


There are (3) = 35 choices of the three places for the letters. For each choice, 


there are (26)°(10)* different license plates. Hence, altogether there are 35 - 
(26) - (10)* different plates. 


Any choice of r of the 1 items is equivalent to a choice of n — r, namely, those 
items not selected. 


(a) 10-9-9...9=10. 97-1 

(b) : 9"—! since there are i choices of the 7 places to put the zeroes and 
then each of the other m — i positions can be any of the digits 1,...,9. 

@ (3) 


E)E)(i)=e-» 


(e) (*) =3 (3) + 3n*(n — 1) + 


There are 9 - 8 - 7 - 6 - 5 numbers in which no digit is repeated. There are 
& - 8 - 7 - 6 numbers in which only one specified digit appears twice, so 
there are 9 (; - 8 - 7 - 6numbers in which only a single digit appears twice. 


There are 7 - FH numbers in which two specified digits appear twice, so there 


are (>) 7: a numbers in which two digits appear twice. Thus, the answer is 


5 9 5! 
9-8-7-6.549(3)-8-7-64()7- 


(a) We can regard this as a seven-stage experiment. First choose the 6 mar- 
ried couples that have a representative in the group, and then select one of 
the members of each of these couples. By the generalized basic principle 
of counting, there are (5 )2° different choices. 

(b) First select the 6 married couples that have a representative in the group, 
and then select the 3 of those couples that are to contribute a man. Hence, 
there are (¢) (8) = aH different choices. Another way to solve this is 
to first select 3 men and then select 3 women not related to the selected 


men. This shows that there are (;)() = win different choices. 


1.12. 


1.13. 


1.14. 


1.15. 


1.16. 


1.17. 


1.18. 
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(5) (3) + (4) (3) = 3430. The first term gives the number of committees 


that have 3 women and 3 men; the second gives the number that have 4 women 
and 2 men. 
(number of solutions of x; + --- + x5 = 4)(number of solutions of x; + +--+ 


x5 = 5)(number of solutions of x; + --- + x5 =6)= (4) (3) ey 
Since there are € a 1 positive vectors whose sum is j, there must be 


ke fe on 
* € _ i: such vectors. But t = is the number of subsets of size n 
j=n 


from the set of numbers {1,...,} in which j is the largest element in the sub- 


ko fs 
set. Consequently, }> € _ il is just the total number of subsets of size n 


jen 
from a set of size k, showing that the preceding answer is equal to (*). 


Let us first determine the number of different results in which k people pass. 


n 


Because there are ( 4 different groups of size k and k! possible orderings of 


their scores, it follows that there are @ k! possible results in which k people 


n 
pass. Consequently, there are )° (7) k! possible results. 
k=0 


The number of subsets of size 4 is (7?) = 4845. Because the number of these 


that contain none of the first five elements is (7) = 1365, the number that 
contain at least one is 3480. Another way to solve this problem is to note that 
there are C) ( i that contain exactly i of the first five elements and sum this 
fori = 1,2,3,4. 

Multiplying both sides by 2, we must show that 


nin — 1l)=k(k — 1) 4+ 2k —k) + (n-k)n-—k — 1) 
This follows because the right side is equal to 


Ma—-24+1)4+k-14+2n-n—-n+14+nm—-1) 


For a combinatorial argument, consider a group of n items and a subgroup 
of k of the n items. Then (5) is the number of subsets of size 2 that contain 
2 items from the subgroup of size k, k(n — k) is the number that contain 1 
item from the subgroup, and (3) is the number that contain 0 items from the 
subgroup. Adding these terms gives the total number of subgroups of size 2, 
namely, (5). 

There are 3 choices that can be made from families consisting of a single parent 
and 1 child; there are 3 - 1 - 2 = 6 choices that can be made from families 
consisting of a single parent and 2 children; there are 5 - 2 - 1 = 10 choices 
that can be made from families consisting of 2 parents and a single child; there 
are 7 - 2 - 2 = 28 choices that can be made from families consisting of 2 parents 
and 2 children; there are 6 - 2 - 3 = 36 choices that can be made from families 
consisting of 2 parents and 3 children. Hence, there are 80 possible choices. 
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1.19. 


First choose the 3 positions for the digits, and then put in the letters and digits. 
Thus, there are (5) - 26-25 .-24-23.22-10-9.- 8 different plates. If the 
digits must be consecutive, then there are 6 possible positions for the digits, 
showing that there are now 6 - 26 - 25 - 24. 23-22-10-9.-8 different 
plates. 


CHAPTER 2 
2.1. (a) 2-3-4=24 
(b) 2.3=6 
(c) 3-4=12 
(d) AB = {(c, pasta, i), (c, rice, i), (c, potatoes, i)} 
(e) 8 


2.2. 


2.3. 


2.4. 


2.5. 


(f) ABC = {(c,rice, i)} 
Let A be the event that a suit is purchased, B be the event that a shirt is pur- 
chased, and C be the event that a tie is purchased. Then 


PAUBUC)=.22 + 304 .28 — 11 — 14 —- 104 .06=.51 


(a) 1 — 51=.49 
(b) The probability that two or more items are purchased is 


P(AB UAC U BC) =.11 + .14 + 10 — .06 — .06 — .06 + .06 = .23 


Hence, the probability that exactly 1 item is purchased is .51 — .23 = .28. 


By symmetry, the 14th card is equally likely to be any of the 52 cards; thus, the 
probability is 4/52. A more formal argument is to count the number of the 52! 
outcomes for which the 14th card is an ace. This yields 


4.51-.50---2-1 4 
(52)! ~~ $9 


p= 


Letting A be the event that the first ace occurs on the 14th card, we have 


48 . 47...36- 4 
P(A) = — 0312 
(A) = 3 51...40 - 39 


Let D denote the event that the minimum temperature is 70 degrees. Then 


P(A U B) = P(A) + P(B) — P(AB) =.7 — P(AB) 
P(C U D) = P(C) + P(D) — P(CD) = 2 + P(D) — P(DC) 


Since A U B = C U D and AB = CD, subtracting one of the preceding 
equations from the other yields 


0=.5 — PD) 


or P(D) =.5. 


52 - 48 - 44 - 40 
“2 32e°°° 
(>) S51 50 749 = 1095 


2.6. 


2.7. 


2.8. 


2.9, 


2.10. 


2.11. 
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Let R be the event that both balls are red, and let B be the event that both are 
black. Then 


P(R U B) = P(R) + P(B) = 2 226 4% 
~ ~G210 ° 62407 


(a) —~ =1.3 x 10-8 


8 
3-4.4.3 
(a) 4 = 1439 
4 
4\ [4 
b 7 0360 
(b) 7 a 
4 
8 
i 0699 
© Tay = 
4 


n 
Let S = L Aj, and consider the experiment of randomly choosing an element 


j=1 
of S. Then P(A) = N(A)/N(S), and the results follow from Propositions 4.3 
and 4.4. 


Since there are 5! = 120 outcomes in which the position of horse number 
1 is specified, it follows that N(A) = 360. Similarly, N(B) = 120, and 
N(AB) = 2. 4! = 48. Hence, from Self-Test Problem 9, we obtain 


N(A U B) = 482. 


One way to solve this problem is to start with the complementary probability 
that at least one suit does not appear. Let Aj, i = 1,2,3,4, be the event that no 
cards from suit i appear. Then 


4 
P (U) =U PA) — D7 PIA) + «+» — P(A1A2A3A4) 
i=1 i 


J ti<j 
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2.12. 


2.13. 


5) 4 
ole 
C2) 
Eee 


The desired probability is then 1 minus the preceding. Another way to solve is 
to let A be the event that all 4 suits are represented, and then use 


P(A) = P(n,n,n,n, 0) + P(n,n,n,o,n) ale P(n,n,o,n,n) ete P(n,o,n,n,n) 


where P(n, n,n, 0,n), for instance, is the probability that the first card is from a 
new suit, the second is from a new suit, the third is from a new suit, the fourth 
is from an old suit (that is, one which has already appeared) and the fifth is 
from a new suit. This gives 


52 - 39 - 26-13 - 48 + 52. 39 . 26 - 36- 13 


52-51-50. 49 - 48 
52 - 39 - 24-26-13 4+ 52-12-39. 26. 13 


52- 51-50-49 - 48 
_ $2.- 39 - 26 - 13(48 + 36 + 24 + 12) 


52-51-50. 49 - 48 


P(A) = 


= .2637 


There are (10)!/2° different divisions of the 10 players into a first roommate 
pair, a second roommate pair, and so on. Hence, there are (10)!/ (5!29) divi- 


sions into 5 roommate pairs. There are ( ; ) ( ; ) ways of choosing the front- 


court and backcourt players to be in the mixed roommate pairs and then 
2 ways of pairing them up. As there is then 1 way to pair up the 
remaining two backcourt players and 4!/(2!27) = 3 ways of making two 
roommate pairs from the remaining four frontcourt players, the desired 


probability is 
(;) (3) 2)@) 
= 5714 


(10)!/(5125) 


P{2 mixed pairs} = 


Let R denote the event that letter R is repeated; similarly, define the events E 
and V. Then 


PI letter} = P(R) + P(E) + P(V) SS ee 
Same tetter; = = { } = 
G6: 76. 76 - Be 
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c 
i-1 

2.14. Let By = Aj, Bj = Aj (U 4) ,1 > 1. Then 
j=l 


i=1 
where the final equality uses the fact that the B; are mutually exclusive. The 
inequality then follows, since Bj C Aj. 


2.15. 


CO 
=1- ) P(A) 
i=1 
=1 


2.16. The number of partitions for which {1} is a subset is equal to the number of 
partitions of the remaining n — 1 elements into k — 1 nonempty subsets, 
namely, 7, 1(n — 1). Because there are 7;(m — 1) partitions of {2,...,n — 1} 
into k nonempty subsets and then a choice of k of them in which to place 
element 1, it follows that there are kT;(n — 1) partitions for which {1} is not a 
subset. Hence, the result follows. 

2.17. Let R, W, B denote, respectively, the events that there are no red, no white, 
and no blue balls chosen. Then 


P(R UW U B)=P(R) + P(W) + P(B) — P(RW) — P(RB) 
— P(WB) + P(RWB) 
7 6 
5 5 


cone 
() (8) (8) () ©) 
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2.18. 


2.19. 


2.20. 


Thus, the probability that all colors appear in the chosen subset is approxi- 
mately 1 — 0.2933 = 0.7067. 


87-65-42 
(a) W716151413 = DI 


(b) Because there are 9 nonblue balls, the probability is meen = a: 
(c) Because there are 3! possible orderings of the different colors and all pos- 


sibilities for the final 3 balls are equally likely, the probability is 
314.85 _ 4 
1716-15 — T7° 


(d) The probability that the red balls are in a specified 4 spots is Wie: 
Because there are 14 possible locations of the red balls where they are all 


together, the probability is Wisse = 0° 


(a) The probability that the 10 cards consist of 4 spades, 3 hearts, 2 diamonds, 
GGG) 
and 1 club is +~“*~—~“*—._ Because there are 4! possible choices 


52 
of the suits to have 43,2, and 1 cards, respectively, it follows that the 
4(S)(G)(2)C) 
(30) . 


(b) Because there are (5) = 6 choices of the two suits that are to have 3 


probability is 


cards and then 2 choices for the suit to have 4 cards, the probability is 
POS)C)C) 
52 . 
(10) 
All the red balls are removed before all the blue ones if and only if the very 


last ball removed is blue. Because all 30 balls are equally likely to be the last 
ball removed, the probability is 10/30. 


CHAPTER 3 


3.1. 


3.2. 


3.3. 


(a) P(no aces) = ( : ) j ( Fe ) 


(b) 1 — P(mo aces) — 


( i ( 1 
i 13 -i 
(c) P(i aces) = 


Let L; denote the event that the life of the battery is greater than 10,000 
i miles. 

(a) P(L2|L1) = P(LiL2)/P(L1) = P(L2)/P(L1) = 1/2 

(b) P(L3|L1) = P(L1L3)/P(L1) = P(L3)/P(L1) = 1/8 


Put 1 white and 0 black balls in urn one, and the remaining 9 white and 10 
black balls in urn two. 
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3.4. Let T be the event that the transferred ball is white, and let W be the event 
that a white ball is drawn from urn B. Then 


P(T|W) = P(W|T)P(T) 
PUW|D)PO) + PW POPO®) 
_ (2/7)2/3) 47; 
(2/7)(2/3) + G/7)(1/3) 
3.5. (a) j4,, because each of the r + w balls is equally likely to be the ith ball 
removed. 
(b), (c) 
| P(RiR)) 
P(Rj|Ri) PIR) 
G 
Ue 
_ ’ —1 
~rtw-i1 


A simpler argument is to note that, for i # j, given that the ith removal 


is a red ball, the jth removal is equally likely to be any of the remaining 
r + w — 1 balls, of which r — 1 are red. 


3.6. Let B; denote the event that ball i is black, and let R; = BY. Then 


P(B\|R>) = P(R2|B,)P(B1) 
2) P(Ra|By)P(B)) + P(Ra|RDP(R) 
_ [r/[b +r + O][b/b +n] 


[r/(b+r4+ O][b/6 +n] +[@ + 0/6 +r4+o][r/b +n] 
b 


= pope e 


3.7. Let B denote the event that both cards are aces. 
(a) 
P{B, yes to ace of spades} 
P{yes to ace of spades} 


OO OE 
Quart 


= 3/51 
(b) Since the second card is equally likely to be any of the remaining 51, of 
which 3 are aces, we see that the answer in this situation is also 3/51. 
(c) Because we can always interchange which card is considered first and 


which is considered second, the result should be the same as in part (b). 
A more formal argument is as follows: 


P{Blyes to ace of spades} = 
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P{B, second is ace} 


P{B|second is ace} = Pisesond ie acel 


P(B) 
~ P(B) + Pf{first is not ace, second is ace} 
_ (4/52)(3/51) 
~ 4/52)B/5D) + (48/52)(4/51) 
= 3/51 
“ PLB) 
P{B\at least one} = ——_——___ 
P{at least one} 
(4/52)(3/51) 
~ 1 — (48/52)(47/51) 


= 1/33 


3.8. 
P(H\E) — P(HE) _ P(H)P(E|H) 
P(G|E)  P(GE) P(G)P(E|G) 


Hypothesis H is 1.5 times as likely. 
3.9. Let A denote the event that the plant is alive and let W be the event that it was 


watered. 
(a) 
P(A) = P(A|W)P(W) + P(A|W)P(W*) 
= 71 8509) & (2)C1) S 785 
” pewe ayy . PAIWOPOV) 
WA as 
_ (8)(1) 16 
~ ois — ae 
(4) 


3.10. (a) 1 — P(nored balls) =1 — 


30 
6 


(b) Given that no red balls are chosen, the 6 chosen are equally likely to be 
any of the 22 nonred balls. Thus, 


P(2 green|no red) = 


3.11. Let W be the event that the battery works, and let C and D denote the events 
that the battery is a type C and that it is a type D battery, respectively. 
(a) P(W) = P(WIC)P(C) + P(W|D)P(D) = .7(8/14) + .4(6/14) = 4/7 
(b) 

PCW’) — P(WIC)P(C) _ .3(8/14) _ 


El PW) 377 ~ Big 


3.12. 


3.13. 


3.14. 
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Let L; be the event that Maria likes book i,i = 1,2. Then 


P(L{L2) — P(L{L2) 
PL) 


P(L2|L4) = 


Using that L2 is the union of the mutually exclusive events L;L2 and L{ L2, we 
see that 


5 = P(L2) = PUL, L2) + P(L)L2) =4+ P(L}L2) 
Thus, 


A 
P(LalL{) = 3 = 25 


(a) This is the probability that the last ball removed is blue. Because each of 
the 30 balls is equally likely to be the last one removed, the probability is 
iy. 

(b) This is the probability that the last red or blue ball to be removed is a blue 
ball. Because it is equally likely to be any of the 30 red or blue balls, the 
probability that it is blue is 1/3. 

(c) Let By, Ro, G3 denote, respectively, the events that the first color removed 
is blue, the second is red, and the third is green. Then 


8 20 8 
P(BiR =P P(R P(By|R =—— => 
(B, R2G3) = P(G3)P(R2|G3)P(Bi|R2G3) 38 30 — 57 
where P(G3) is just the probability that the very last ball is green and 
P(R2|G3) is computed by noting that, given that the last ball is green, 
each of the 20 red and 10 blue balls is equally likely to be the last of that 
group to be removed, so the probability that it is one of the red balls is 
20/30. (Of course, P(B,|R2G3) = 1.) 
(d) P(B,) = P(B\G2R3) + P(BiR2oG3)= H+ 5=4 
Let H be the event that the coin lands heads, let 7), be the event that B is told 
that the coin landed heads, let F be the event that A forgets the result of the 
toss, and let C be the event that B is told the correct result. Then 
(a) 


P(Th) = P(Ty|F)PP) + PTF PP) 
= (.5)(4) + P(H)(.6) 


= .68 
(b) 
P(C) = P(C|F)P(F) + P(C|IFS) PF) 
= (.5)(.4) + 1(.6) = .80 
(c) 


P(HT),) 
P(Th) 


P(EL|T;,) = 
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3.15. 


3.16. 


3.17. 


Now, 


P(AT,) = PAT) |F)P@) + PCIT, PF) PE) 
= PAP)PT,)\|AP)PY) + PGDPE) 
= (.8)(.5)(.4) + (.8)(.6) = .64 


giving the result P(7|T),) = .64/.68 = 16/17. 

Since the black rat has a brown sibling, we can conclude that both of its parents 
have one black and one brown gene. 

(a) 

P(2) 1/4 1 


P(2 black|at least one) = = = 
P(atleastone) 3/4 3 


(b) Let F be the event that all 5 offspring are black, let Bz be the event that 
the black rat has 2 black genes, and let B; be the event that it has 1 black 
and 1 brown gene. Then 


P(B|F) = P(F|B2)P(B2) 
2 P(F|B2)P(B2) + P(F|Bi)P(B)) 
(1)(1/3) _ 16 


~ (1)(1/3) + (1/2)5(2/3) 17 


Let F be the event that a current flows from A to B, and let C; be the event 
that relay i closes. Then 


P(F) = P(F|Cy)pi + P(FICDC — pi) 


Now, 
P(P|Cy) = P(Cy U C2C5) 
= P(C4) + P(C2Cs5) — P(C4C2Cs) 
=P4 + Pp2Pps — P4p2Ps5 
Also, 


P#|C) = P(Q2C5 U C2C3C4) 
= P2Ps5 + P2P3P4 — P2P3P4Ps 


Hence, for part (a), we obtain 


P(F) = pi(pa + pops — pap2ps) + (1 — pi)p2(ps + p3p4a — p3paps) 
For part (b), let gi = 1 — p;. Then 
P(C3|F) = PCa) P(C3) (PX) 
=p3[l — P(CIG, U Gce)/Pe) 
= p3(1 — qiq2 — gags + 91929495)/P(P) 


Let A be the event that component 1 is working, and let F be the event that 
the system functions. 


(a) 
P(AF) _ P(A) _ 1/2 2 


PF) P(F) 1—-d/2 3 


P(A|F) = 


3.18. 


3.19. 


3.20. 
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where P(F) was computed by noting that it is equal to 1 minus the prob- 
ability that components 1 and 2 are both failed. 

(b) 

P(AF) _ P(FIA)P(A) _ (3/4) (1/2) 3 


PAID = Soy = PURO Gay? + 3G 4 


where P(F) was computed by noting that it is equal to the probability that 
all 3 components work plus the three probabilities relating to exactly 2 of 
the components working. 
If we assume that the outcomes of the successive spins are independent, then 
the conditional probability of the next outcome is unchanged by the result that 
the previous 10 spins landed on black. 
Condition on the outcome of the initial tosses: 


P(A odd) = Pi (1 — P2)0 — P3) + ( — Py) P2P3 + Pi P2P3(A odd) 
+ (1 — Py) — P2)Q — P3)P(A odd) 
so, 
Po. = Po)d = £3) + (Pi PaPs 


P(A odd) = P 
1+ P2 + P3 — Pi P2 — Pi P3 — P2P3 


Let A and B be the events that the first trial is larger and that the second is 
larger, respectively. Also, let E be the event that the results of the trials are 
equal. Then 

1= P(A) + P(B) + P(E) 


But, by symmetry, P(A) = P(B): thus, 


n 
bs OP 
Li PE). i=1 
2 a 2 


Another way of solving the problem is to note that 


P(B) = 


P(B) = a > P{first trial results in 7, second trial results in /} 


i j>i 


= y pp 


i j>i 
To see that the two expressions derived for P(B) are equal, observe that 


n n 
i=) pid 2 


i=1 j=l 


= DL Piri 
= Di + SOS pipj 


i jAl 


= opi + 20> pin 


i j>i 
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3.21. Let E = {A gets more heads than B}; then 


P(E) = P(E|A leads after both flip 1) P(A leads after both flip 7) 
+ P(E| even after both flip 7)P( even after both flip 7) 
+ P(E|B leads after both flip 7)P(B leads after both flip 7) 


1 
= P(A leads) + a even) 


Now, by symmetry, 


P(A leads) = P(B leads) 
_ 1 — P(even) 
a 2 


Hence, 


1 
P(E) = 5 


3.22. (a) Not true: In rolling 2 dice, let E = {sum is 7}, F= {1st die does not land on 4}, 
and G= {2nd die does not land on 3}. Then 


P{7,not (4,3)} 5/36 


P(E|F UG = Pinot (4.3) > 35/36 = 5/35 # P(E) 
(b) 
P(E(F U G)) = P(EF U EG) 
= P(EF) + P(EG) since EFG = @ 
= P(E)[P(F) + P(G)| 
= P(E)P(F U G) since FG = @ 
(c) 
~ PXEFG) 
P(G\|EF) = PEF) 
= Aaa) since E is independent of FG 
P(EF) 
= EEG) by independence 
~~ PEPE) ar 
= P(G). 


3.23. (a) necessarily false; if they were mutually exclusive, then we would have 
0 = P(AB) # P(A)P(B) 
(b) necessarily false; if they were independent, then we would have 
P(AB) = P(A)P(B) > 0 
(c) necessarily false; if they were mutually exclusive, then we would have 
P(A U B)= P(A) + P(B) = 1.2 


(d) possibly true 
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3.24. The probabilities in parts (a), (b), and (c) are .5, (8) = .512, and (.9)7 © .4783, 
respectively. 


3.25. Let D;,i = 1,2, denote the event that radio i is defective. Also, let_A and B 
be the events that the radios were produced at factory A and at factory B, 
respectively. Then 


P(D,D2) 

PD) 
_ P(DD2|A)P(A) + P(D1D2|B)P(B) 
~  P(D,|A)P(A) + P(D1|B)P(B) 
_ (.05)*(1/2) + (.01)7(1/2) 
~ (.05)(1/2) + (.01)(1/2) 
= 13/300 


P(D2|D1) = 


3.26. We are given that P(AB) = P(B) and must show that this implies that P(BSA‘) = 
P(A‘). One way is as follows: 


P(BCA‘) = P((A U B)*) 


4 PU eR) 

=1— P(A) — P(B) + P(AB) 
=1 =F) 

= P(A‘) 


3.27. The result is true for n = 0. With A; denoting the event that there are i red 
balls in the urn after stage n, assume that 


1 
BO) at i=l,....n+1 


Now let B;,j = 1,...,m + 2, denote the event that there are j red balls in the 
urn after stage nm + 1. Then 


n+1 
P(Bj) = > P(BiAi)P(Ai) 
i=1 
1 n+1 


= Y > PUB\IAd) 


n+14 
i=1 


1 
=F [P(BlAj-1) + P(B;\Aj)] 
Because there aren + 2 balls in the urn after stage n, it follows that P(Bj|Aj_1) 
is the probability that a red ball is chosen when j — 1 of then + 2 balls in the 
urn are red and P(B;|Aj) is the probability that a red ball is not chosen when j 
of the n + 2 balls in the urn are red. Consequently, 


im 
n+2° 


n+2—-j 
n+2 


P(Bj\Aj_-1) = P(B;\Aj) = 
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3.28. 


3.29, 


Substituting these results into the equation for P(B;) gives 


P(Bj) = 


Pal g Maes) oh 
n+1|[n+2 ' n+2 “n- 2 
This completes the induction proof. 


If A; is the event that player i receives an ace, then 


Led otal 
(7") 7 Jn =1- 44 = 2 


n 


By arbitrarily numbering the aces and noting that the player who does not 
receive ace number one will receive n of the remaining 2n — 1 cards, we 
see that 


n 
P(AzA3) = ar 


Therefore, 


P(A,A2) = n—-1 
P(A})  3n-—1 


P(A5|A1) =1 — P(A2|A1) =1 


We may regard the card division outcome as the result of two trials, where trial 
i,i = 1,2, is said to be a success if ace number i goes to the first player. Because 
the locations of the two aces become independent as n goes to infinity, with 
each one being equally likely to be given to either player, it follows that the 
trials become independent, each being a success with probability 1/2. Hence, 
in the limiting case where n—>oo, the problem becomes one of determining 
the conditional probability that two heads result, given that at least one does, 
when two fair coins are flipped. Because fal converges to 1/3, the answer 
agrees with that of Example 2b. 


(a) For any permutation ij,...,i, of 1,2,...,n, the probability that the suc- 
cessive types collected is ij,...,in 18 Di, -** Di, = Tha pi. Consequently, 
the desired probability is n! [| ]j_, pi. 

(b) For ij,...,i, all distinct, 


P(E;, «++ Ei) = (“ — =) 


n 


which follows because there are no coupons of types i1,...,i4 when each 
of the n independent selections is one of the other n — k types. It now 
follows by the inclusion—exclusion identity that 


no py yay {2 n—k\" 
PULIED = ) iD) ei = ) 
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Because 1 — P(U‘_, Ej) is the probability that one of each type is obtained, 


n! 


by part (a) it is equal to 7,. Substituting this into the preceding equation 


gives 
n! . n\ (n — k\" 
{ Se _4)k+1 
ae) aw 
k=1 
or 
if n 
ni =n" — Deve (Dan — ky" 
k=1 
or 


we Deva — ky" 
k=0 


3.30. 
P(E|E U F) = P(E|F(E U F))P(FIE U F) + P(E|F°(E U F))P(F|E U F) 


Using 
FEUP=F and F(EUPD=PE 
gives 
PLE U F)=P(E|F)PPIE U PF) + P(E|EP) PCE U FP) 
= P(E|F)P(FIE U FF) + PE U F) 
= P(E|F)P(FIE U F) + P(E|F)P(F'|E U F) 
= P(E|F) 
CHAPTER 4 


4.1. Since the probabilities sum to 1, we must have 4P{X = 3} + .5 = 1, implying 
that P{X = 0} = 375, P{X = 3} = .125. Hence, E[X] = 10.3) + 262) + 
3(.125) = 1.075. 


4.2. The relationship implies that p; = c'po,i = 1,2, where p; = P{X = i}. Because 
these probabilities sum to 1, it follows that 


1 
1 | eee 
pol +c+c)=1=> po Paar: 
Hence, 
c + 2c? 
E[X]|= | 2p7 = 
[X] = pi + 2p2 ee 


4.3. Let X be the number of flips. Then the probability mass function of X is 


p2=p’ + —p)*, p3=1— po=2p01 — p) 
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Hence, 


E[X] = 2p2 + 3p3 =2p2 + 301 — po) =3 — p? — A — py’ 


4.4. The probability that a randomly chosen family will have i children is nj/m. 
Thus, 


E[X] = )oini/m 


Also, since there are in; children in families having i children, it follows that 
the probability that a randomly chosen child is from a family with i children is 
r 
in;/ >> in;. Therefore, 

i=l 


Thus, we must show that 


i=1 i=1 
r r 
vin om 
i=1 i=1 
or, equivalently, that 
r r r r 
ny Pm = Din Din 
j=l i=l = Fel 


or, equivalently, that 


r r r r 
SY Pang = OY ain 
i=1 j=1 i=1 j=1 
But, for a fixed pair i, j, the coefficient of njn; in the left-side summation of 
the preceding inequality is i? + j?, whereas its coefficient in the right-hand 


summation is 2ij. Hence, it suffices to show that 
PEP Sly 
which follows because (i — j)* = 0. 


4.5. Let p = P{X = 1}. Then E[X] = p and Var(X) = p(1 — p),so 


p =3p(1 — p) 
implying that p = 2/3. Hence, P(X = 0} = 1/3. 


4.6. 


4.7. 


4.8. 
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If you wager x on a bet that wins the amount wagered with probability p and 
loses that amount with probability 1 — p, then your expected winnings are 


ap =x = pj) =] Cp = 1x 


which is positive (and increasing in x) if and only if p > 1/2. Thus, if p = 1/2, 
one maximizes one’s expected return by wagering 0, and if p > 1/2, one maxi- 
mizes one’s expected return by wagering the maximal possible bet. Therefore, 
if the information is that the .6 coin was chosen, then you should bet 10, and if 
the information is that the .3 coin was chosen, then you should bet 0. Hence, 
your expected payoff is 


1 Hl 
1.2 — 1)10 + =0 =1- 
5/ ) 5 Cc C 


Since your expected payoff is 0 without the information (because in this case 

the probability of winning is 5(.6) + }(.3) < 1/2), it follows that if the infor- 

mation costs less than 1, then it pays to purchase it. 

(a) Ifyou turn over the red paper and observe the value x, then your expected 
return if you switch to the blue paper is 


2x(1/2) + x/2(1/2) = 5x/4 > x 


Thus, it would always be better to switch. 

(b) Suppose the philanthropist writes the amount x on the red paper. Then 
the amount on the blue paper is either 2x or x/2. Note that if x/2 = y, then 
the amount on the blue paper will be at least y and will thus be accepted. 
Hence, in this case, the reward is equally likely to be either 2x or x/2, so 


E[Ry(x)] =5x/4, ifx/2=y 


Ifx/2 < y = 2x, then the blue paper will be accepted if its value is 2x and 
rejected if it is x/2. Therefore, 


E[Ry@)] = 2x(1/2) + x01/2)=3x/2, ifx/2 < y = 2x 


Finally, if 2x < y, then the blue paper will be rejected. Hence, in this case, 
the reward Is x, so 


R@=s*, wax =—y 


That is, we have shown that when the amount x is written on the red 
paper, the expected return under the y-policy is 


x ifx < y/2 
E[Ry(x)] = } 3x/2 ify/2 <x < 2y 
5x/4 ifx = 2y 


Suppose that n independent trials, each of which results in a success with prob- 
ability p, are performed. Then the number of successes will be less than or 
equal to iif and only if the number of failures is greater than or equal ton — i. 
But since each trial is a failure with probability 1 — p, it follows that the num- 
ber of failures is a binomial random variable with parameters n and 1 — p. 
Hence, 
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P{Bin(n,p) = i} = P{Bin (4,1 — p) =n — i} 
=1— P{Bin(m,1 — p) =n —-i-— 1} 


The final equality follows from the fact that the probability that the number 
of failures is greater than or equal ton — i is 1 minus the probability that it is 
less thann — i. 


4.9. Since E[X] = np, Var(X) = np(1 — p), we are given that np = 6,np(1 — p) = 
2.4. Thus, 1 — p= .4, or p = .6,n = 10. Hence, 
10 
P(X =5}= ( 5 ) (.6)°(.4)° 


4.10. Let_X;,i=1,...,m, denote the number on the ith ball drawn. Then 


P(X Sky = P{X, = kX) S=k,...,.X¥n = 
= P{X, = k}P{X. = k}--- P{Xm = k} 


-(') 


PIX -~k}=P(X <k} — PIX <k—- y=(*)" (— *)" 


n 


Therefore, 


4.11. (a) Given that A wins the first game, it will win the series if, from then on, it 
wins 2 games before team B wins 3 games. Thus, 


4 


P{A wins|A wins first} = » (*) pil — p)** 
i=2 


(b) 


P{A wins|A wins first}P{A wins first} 
P{A wins} 


P{A wins first|A wins} = 
4 


> (*) pitta — pyti 


@) pup 


4.12. To obtain the solution, condition on whether the team wins this weekend: 


2 
5 
i=3 


4 


4 
Sy (7) (4.6/7 + 5° (7) ..7)'¢3) 


i=3 i=3 
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4.13. Let C be the event that the jury makes the correct decision, and let F be the 
event that four of the judges agreed. Then 


7 


7 : : 
(ee (Joni 


i=4 
Also, 


P(CF) 
P(F) 


7 (ony 

~ (7) 4033 + (2) 93034 
( 

=. 


P(C\F) = 


4.14. Assuming that the number of hurricanes can be approximated by a Poisson 
random variable, we obtain the solution 


3 


ye 7(5.2)//i! 


4.15. 
E[Y] = )_iP{X = i}/P{X > 0} 
al 
= E[X]/P{X > 0} 
; 


={— es 


4.16. (a) 1/n 
(b) Let D be the event that girl i and girl j choose different boys. Then 
P(GiGj) = P(GiGj|D)P(D) + P(GiGi|DP(D*) 
= (1/ny(1 — 1/n) 


1 


ne 


Therefore, 


n—-1 
P(Gj|Gj) = oe 


(c), (d) Because, when n is large, P(G;|G;) is small and nearly equal to P(Gj), 
it follows from the Poisson paradigm that the number of couples is 
approximately Poisson distributed with mean )~’_, P(Gj) = 1. Hence, 
Po © e-! and Py © e7!/k! 

(e) To determine the probability that a given set of k girls all are coupled, 
condition on whether or not D occurs, where D is the event that they all 
choose different boys. This gives 


482 
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4.17. (a) 


4.18. 


(b) 


(c) 


(d) 


(a) 
(b) 


P(Gi, «+» Gy) = P(Gi, +++ Gi,|D)P(D) + P(Gi, «+» Gi,| DPD) 
= P(Gj, -+- Gi,|D)P(D) 
,n(n — 1)---a—-—k-+1) 


= (1 
(1/n) - 
n!} 
~ (n — kink 
Therefore, 
n nin! 
P(G;, --»G;,) = P(G;, ---G;,) = 
, eae Oo ae (n — k(n — k)!k!n2k 


and the inclusion—exclusion identity yields 


nin! 


aT Se : k4+1 
LS Py PUG = CD" ae, 


k=1 


Because woman i is equally likely to be paired with any of the remaining 
2n — 1 people, P(W;) = =o 

Because, conditional on W;, woman i is equally likely to be paired with 
any of 2n — 3 people, P(W;|W;) = 4 

When n is large, the number of wives paired with their husbands will 
approximately be Poisson with mean )“_, P(Wi) = 5“, ® 1/2. There- 


2n—1 ~~ 
fore, the probability that there is no such pairing is approximately e~!/?. 


It reduces to the match problem. 


(5) (9/19)3(10/19)°(9/19) = (5) (9/19)*(10/19)> 


If W is her final winnings and X is the number of bets she makes, then, 
since she would have won 4 bets and lost XY — 4 bets, it follows that 


W =20 — 5X — 4)=40 — 5X 
Hence, 


E[W] = 40 — 5E[X] = 40 — 5[4/(9/19)] = —20/9 


4.19. The probability that a round does not result in an “odd person” is equal to 1/4, 
the probability that all three coins land on the same side. 


(a) 
(b) 


(1/4)°(3/4) = 3/64 
(1/4)* = 1/256 
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4.20. Letg =1 — p. Then 


4.21. 


4.22. 


4.23. 


Since x) will equal 1 with probability p or 0 with probability 1 — p, it follows 
that it is a Bernoulli random variable with parameter p. Because the variance 
of such a Bernoulli random variable is p(1 — p), we have 


; Var(X) 


X —b 1 
pa - p) = Var ( (a — b) 


dt 
a >) = a= os b)= 


Hence, 
Var(X) = (a — b)’p(1 — p) 


Let X denote the number of games that you play and Y the number of games 

that you lose. 

(a) After your fourth game, you will continue to play until you lose. There- 
fore, X — 4is a geometric random variable with parameter 1 — p,so 


1 
E[X] = F[4 + (X — 4) =44 EX - 4)=4+4+ ess 
mete i 
(b) If we let Z denote the number of losses you have in the first 4 games, then 
Z is a binomial random variable with parameters 4 and 1 — p. Because 
Y=Z + 1, we have 


E[Y]= E[Z + 1J)=£[Z] +1=40 - p) +1 


A total of n white balls will be withdrawn before a total of m black balls if 
and only if there are at least n white balls in the first m + m — 1 withdrawals. 
(Compare with the problem of the points, Example 4; of Chapter 3.) With X 
equal to the number of white balls among the first n + m — 1 balls withdrawn, 
X is a hypergeometric random variable, and it follows that 
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N M 
n+m—1 n+m—1 i n+m—-1-i 


Mikes ) Fest] > ERR; 
i=n i=n ie) 


4.24. Because each ball independently goes into urn i with the same probability pj, it 
follows that _X; is a binomial random variable with parameters n = 10, p = pj. 
First note that X; + Xj is the number of balls that go into either urn i or 
urn j. Then, because each of the 10 balls independently goes into one of these 
urns with probability p; + pj, it follows that X; + Xj is a binomial random 
variable with parameters 10 and p; + pj. 
By the same logic, X; + X2 + X3 is a binomial random variable with param- 
eters 10 and p; + p2 + p3. Therefore, 


10 
P{X, + X2 + X3= 7} = (Fo + po + ps)’(pa + ps)? 


4.25. Let X; equal 1 if person i has a match, and let it equal 0 otherwise. Then 
n 
ee ees 
i=1 
is the number of matches. Taking expectations gives 
n n n n 
EX|=Ey A=) Ea =) Pee a=) ina 
i=1 i=1 i=1 i=1 


where the final equality follows because person i is equally likely to end up 
with any of the 7 hats. 
To compute Var(X), we use Equation (9.1), which states that 


E[X?] = > E[X] + 0 > ELXX]] 
i=l 


i=l j#i 

Now, for i # j, 
E[X;Xj] = P(X; = 1, X; = 1) = PLAX; = 1) PG = 1|X; = 1} = — 
Hence, 
2 : 1 
E[X?]=1 + dX, 2 aT 
1 
=e Gi — i 

which yields 


Var(X) =2 — 17 =1 
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4.26. With g = 1 — p, we have, on the one hand, 


Piajy= > Pix =2i) 
i=l 


Pq __4 
ad-qgd+q 1+4 


On the other hand, 
P(E) = P(E|X =1)p + P(E|X > IDq=qP(E|X > 1) 
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However, given that the first trial is not a success, the number of trials needed 
for a success is | plus the geometrically distributed number of additional trials 


required. Therefore, 
P(E|X > 1) = P(X + 1iseven) = P(E°) = 1 — P(E) 


which yields P(E) = q/(1 + q). 


CHAPTER 5 


5.1. Let X be the number of minutes played. 
(a) P{X > 15}=1 — P{X = 15} =1 — 5(.025) = .875 
(b) P{20 < X < 35} = 10(.05) + 5(.025) = .625 
(c) P{X < 30} = 10(.025) + 10(.05) = .75 
(d) P{X > 36} = 4(.025) = 1 
5.2. (a) 1= fj} cx"dx = c/(n +1>c=n+4+1 
1 
(b) P(X > he (n $1) fi xtde sx") a1 - xt! 
x 


5.3. First, let us find c by using 


2 
1= / cx4dx = 32c/5 => c = 5/32 
0 


(a) E[X] = 3 fp Pdx = 54 =5/3 


(b) E[X2] = 3 fp x8dx = $138 = 20/7 = Var(X) = 20/7 — (5/3)? = 5/63 


1 
1 =) (ax + bx*)dx =a/2 + b/3 
0 


1 
=f (ax* + bx*)dx = a/3 + b/4 
0 
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5.5. 


5.6. 


5.7. 


5.8. 


5.9. 


we obtain a = 3.6,b = —2.4. Hence, 


1/2 
(a) P{X < 1/2} = J)’ G.6x — 2.4x*)dx = (1.8x2 — 8x3) 5 = 35 


(b) E[X?] = f} B.63 — 2.4x4)dx = 42 > Var(X) = .06 


Fori=1,...,n, 
P{X = i} = P{Int(nU) =i — I} 
=P{i-1=nU < ij} 
i-1 i 
=| =U< “} 
n n 
=1/n 
If you bid x,70 = x = 140, then you will either win the bid and make a profit 


of x — 100 with probability (140 — x)/70 or lose the bid and make a profit of 
0 otherwise. Therefore, your expected profit if you bid x is 


j 1 
za" - 100)(140 — x) = zp (240x x* — 14000) 


Differentiating and setting the preceding equal to 0 gives 
240 — 2x =0 


Therefore, you should bid 120 thousand dollars. Your expected profit will be 
40/7 thousand dollars. 
(a) P{U > 1} = 9/10 
(b) P{U > .2|U > 1J=P{U > .2}/P{U > 1} =8/9 
(c) P{U > 3|U > .2,U > AJ=P{U > 3}/P{U > .2}=7/8 
(d) P{U > .3}=7/10 
The answer to part (d) could also have been obtained by multiplying the prob- 
abilities in parts (a), (b), and (c). 
Let X be the test score, and let Z = (X — 100)/15. Note that Z is a standard 
normal random variable. 
(a) P{X > 125} = P{Z > 25/15} ~ .0478 
(b) 
P{90 < X < 110} = P{—-10/15 < Z < 10/15} 
= P{Z < 2/3} — P{Z < —2/3} 
= P{Z < 2/3} — [1 — P{Z < 2/3}] 
= .4950 


Let X be the travel time. We want to find x such that 
P{X > x} = .05 


which is equivalent to 


xX — 40 x — 40 
P > = .05 
7 7 


That is, we need to find x such that 


x — 40 
Plz > 7 | = 03 
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where Z is a standard normal random variable. But 
P{Z > 1.645} = .05 
Thus, 


x 40 1645 or x= 51515 


Therefore, you should leave no later than 8.485 minutes after 12 P.M. 


5.10. Let X be the tire life in units of one thousand, and let Z = (XY — 34)/4. Note 
that Z is a standard normal random variable. 
(a) P{X > 40} = P{Z > 1.5} = .0668 
(b) P{30 < X < 35} = P{-1 «< Z < .25}=P{Z < 25} — P{Z > 1} = .44 
(c) 


P{X > 40|X > 30} = P{X > 40}/PLX > 30} 
= P{Z > 1.5}/P{Z > —1} © .079 


5.11. Let X be next year’s rainfall and let Z = (X — 40.2)/8.4. 
(a) P{X > 44} = P{Z > 3.8/8.4} » P{Z > .4524} = .3255 


(b) ( : ) (.3255)3(.6745)4 
5.12. Let M; and W; denote, respectively, the numbers of men and women in the 


samples that earn, in units of one thousand dollars, at least i per year. Also, let 
Z be a standard normal random variable. 


(a) 
P{W 5 = 70} = P{Wo5 = 69.5} 
ap Ws — 200(.34) _ 69.5 — 200(.34) 
a J/200(.34)(.66) —-/200(.34)(.66) 
= P{Z = .2239} 
=~ 4114 
(b) 


P{Mo5 < 120} = P{Mo5 < 120.5} 

Mp5 — (200)(.587) _ 120.5 — (200)(.587) 
~ | Sargeras ~ “FEO SST 413) | 
P{Z < 4452} 

6719 


2 


2 
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(c) 
P{My) = 150} = P{My9 = 149.5} 
_ ah — (200)(.745) _ 149.5 — Sere | 
J(200)(.745)(.255) -/(200)(.745)(.255) 
~ P{Z = 0811} 
~ 4677 
P{W) = 100} = P{Wo9 = 99.5} 
_ P| Woo — (200)(.534) _ 99.5 — Sa 
/(200)(.534)(.466) _/(200)(.534)(.466) 
~ P(Z = —1.0348} 
= ~,8496 
Hence, P{Mo9 = 150}P{Wo9 = 100} © .3974 


5.13. The lack of memory property of the exponential gives the result e~*/°. 
5.14. (a) e-? —e-4 
(b) F(3) — FQ) =e! - e&? 
(c) A) = 2te-* Jew =2t 
(d) Let Z be a standard normal random variable. Use the identity ELX] = 
Jo. P{X > x} dx to obtain 


etx] = [ e* dx 
0 


[o-e) 
= ae. ey 2 dy 
0 
=2-'/2,/2nP{Z > 0} 
= Jx/2 


(e) Use the result of Theoretical Exercise 5 to obtain 


(oe) CO 


E[X?] = / 2xe* dx=—e* | =1 
0 


0 
Hence, Var(X) =1 — 7/4. 
5.15. (a) P{X > 6} = exp{—[P A@dn = e 3 
(b) 
PLY = 8X s 631 - PX = 8y = 6 

=1— P{X > 8}/P{X > 6} 
= 1 — ¢75-65 79-345 
= 8892 

5.16. For x = 0, 


Fijx(x) = P{(1/X & x} 
= P{X <0} + P(X = 1/x} 
=1/2+1—- Fy(1/x) 
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Differentiation yields 


II 


x fy (1/x) 

_ 1 

~ x2n(1 + (1/x)?) 
= fx(x) 


fisx@) 


The proof when x < 0 is similar. 


5.17. If X denotes the number of the first n bets that you win, then the amount that 
you will be winning after n bets is 


35X — (n — X)=36X —n 
Thus, we want to determine 
p= P{36X —n > 0} = P{X > n/36} 


when _ X is a binomial random variable with parameters n and p = 1/38. 
(a) Whenn = 34, 


p=P{x=1} 

= P{X > .5} (the continuity correction) 

=| X= 34/38 5S ~ 34/38 | 
V34(1/38) (37/38) V34(1/38) (37/38) 

=| sg «223} 
/34(1/38) (37/38) 

~ @(.4229) 

~ 6638 


(Because you will be ahead after 34 bets if you win at least 1 bet, the exact 
probability in this case is 1 — (37/38)*4 = .5961.) 
(b) When xz = 1000, 


p=P{X > 27.5} 


_ X — 1000/38 : 27.5 — 1000/38 
/1000(1/38) (37/38) /1000(1/38) (37/38) 

=~ 1 — (.2339) 

~ .4075 


The exact probability—namely, the probability that a binomial m = 1000, 
p = 1/38 random variable is greater than 27—is .3961. 
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(c) When x = 100,000, 
p= P{X > 2777.5} 


X — 100000/38 2777.5 — 100000/38 
= > 

/100000(1/38) (37/38) /100000(1/38) (37/38) 
= 1 — (2.883) 


= .0020 


The exact probability in this case is .0021. 
5.18. If X denotes the lifetime of the battery, then the desired probability, 
P{X > s + t|\X > ft}, can be determined as follows: 


P{(X >s+t,X > t} 
P{LX > tf 
P(X >s+ th} 
PIX >A 
P{X>s+1\battery is type lip, 
+P{X>s4+z|battery is type 2}p2 
P{xX>t\battery is type 1jp; 
+P{X>t\battery is type 2}p> 
e+) py “fe e 2849 no 


PX >st+tX > Hh= 


ae ae Me 27) 
Another approach is to directly condition on the type of battery and then 
use the lack-of-memory property of exponential random variables. That is, 
we could do the following: 

P{X >s4+tX > Hfh=P{X > s+ 1tX > ttype1}P{type1|X > 4 
+ P{xX >s4 t|X > t,type 2}P{type 2|\X > 2} 
=e 5 P{type 1|X > t} + e%25P{type 2|X > 4 

Now for i = 1,2, use 
P{typei,X > t} 


P{typei|X > f= PX > ad 


_ P{X > t\type i}pi 

~ P(X > t\type 1}p; + P{X > tl|type 2}p2 

_ ent; 
ern py peat pp 


5.19. Let X; be an exponential random variable with mean i, i = 1,2. 
(a) The value c should be such that P{X; > c} = .05. Therefore, 


e © =.05 = 1/20 


or c = log(20) = 2.996. 
(b) 


1 
PIGS > cleo? = —— & 3936 
{X2 } Wr 
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5.20. (a) 


E[(Z — c)*]= I — cyte 2 dx 


1 [oe) 
7 ai 
1 oa a 1 on 2 
———— = 2d 2 —Xx 2d 
xe x ce x 
=! cal 


(x — oe* dx 


- “ae? IP — c(1 — O(c) 
= ae c(1 — ®(c)) 
JIT 


(b) Using the fact that X has the same distribution as uw + oZ, where Z isa 
standard normal random variable, yields 


E[(X — 0)t] = E(u + oZ — 0)*] 


-#f((e-*54)) | 


Oo 


-08|(z- —)"] 


=% el _ ad — | 


where a= <¥. 


CHAPTER 6 


6.1. (a) 3C + 6C=15C=1/9 
(b) Let p(i,j) = P(X =i, Y =j}. Then 


pd, 1) = 4/9, pd, 0) = 2/9, P(O, 1) = 1/9, p(0, 0) = 2/9 


(12)! 
“Oe. 
(12)! 
(4p3 
12 12 . ied 
() > ( ) (2/3) 3)? 

i=8 

6.2. (a) With pj = P{XYZ = j}, we have 


(1/9)°(2/9)° 


U0 


Po = P2 = Pa = P12 = 1/4 


Hence, 
E[XYZ] = (6 +2 +44 12)/4=6 
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(b) With gj = P{XY + XZ + YZ =j}, we have 


qi =95 = 948 = 416 = 1/4 


Hence, 
E[XY + XZ + YZ]=(11 + 54+ 8 + 16)/4=10 


6.3. In this solution, we will make use of the identity 


(oe) 
/ e*x" dx =n! 
0 


which follows because e*x"/n!,x > 0, is the density function of a gamma 
random variable with parameters m + 1 and A and must thus integrate to 1. 


(a) 
oo y 
1=c| zal (y — x) dxdy 
0 =y 
lee) 
2C / eY2y" dy = 4C 
0 
Hence, C = 1/4. 
(b) Since the joint density is nonzero only when y > x andy > —x, we have, 
forx > 0, 
1 (oe) 
fx@) = i/ (y — xje* dy 
x 
= i/ ue **) dy 
4 Jo 
1 
— ao 
Forx < 0, 


1 
fx@) = q (y = x)e” dy 


= (—2xe* + &)/4 


() fr) =7e° 2,0 — Ndx = aye? 


(d) 
1 0 
AL xe *dx 4 ie (—2x7e* 4 sed 
1 
=)1-[° (2y’eY + ye yay] 


=-[1-4-1]=-1 


E[X] = 


(e) E[Y]= 5 ie ye dy =3 


6.4. 


6.5. 


6.6. 


6.7. 
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The multinomial random variables Xj,i = 1,...,7, represent the numbers of 
each of the types of outcomes 1,...,7 that occur in m independent trials when 
each trial results in one of the outcomes 1,...,7 with respective probabili- 
ties p1,...,pr- Now, say that a trial results in a category 1 outcome if that 
trial resulted in any of the outcome types 1,...,7; say that a trial results 
in a category 2 outcome if that trial resulted in any of the outcome types 
ry + 1,...,7 + 72; and so on. With these definitions, Y;,..., ¥, represent 
the numbers of category 1 outcomes, category 2 outcomes, up to category k 


outcomes when n independent trials that each result in one of the categories 
1,...,k with respective probabilities Beane pip t= 1hs++4k,-ate pertormed. 


But by definition, such a vector has a multinomial distribution. 
(a) Letting pj = P{XYZ = j}, we have 


pPi=1/8, pr =3/8, pa =3/8, pg =1/8 
(b) Letting pj = P(XY + XZ + YZ =j}, we have 
p3=1/8, ps =3/8, pg = 3/8, pi2=1/8 
(c) Letting pj = P{X* + YZ = jj}, we have 
p2=1/8, p3=1/4, ps=1/4, po=1/4, pg =1/8 


(a) 
1 ps5 
fe i (x/5 + cy) dy dx 
0 v1 


1 

-| (4x/5 + 12c) dx 
0 

=12c + 2/5 


Hence, c = 1/20. 
(b) No, the density does not factor. 
(c) 


1 fs 

PX+Y> a= / / (x/5 + y/20) dy dx 
0 J3-x 

1 

0 

= 1/5 + 1/15 + 5/8 — 19/120 = 11/15 


= 7 [2+ als 25/40 — G— x7 /40] de 


(a) Yes, the joint density function factors. 
(b) fx =x fo ydy=2x, O<x <1 


() fy) =yfyxdx=y/2, O<y <2 
(d) 


P{X < x,Y < y}=P{X < x}P{Y < y} 
= min(1,x*) min(1,y/4), x > 0,y > 0 


(e) ELY] = fo y?/2dy = 4/3 
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6.8. 


6.9. 


6.10. 


6.11. 


6.12. 


(f) 
1 1-x 
px+y<y= [orf ydy dx 
0 0 
1. 2 
-;/ x(1 — x)* dx = 1/24 
2 Jo 


Let 7; denote the time at which a shock type i, of i = 1,2,3, occurs. For 
s > 0,t > 0, 


P{X, > s,Xo > th= P{T, > s,T2 > t,T3 > max(s,f)} 
= P{T, > s}P{T2 > t}P{T3 > max(s,d} 
= exp{—Aj1s} exp{—Azt} exp{—A3 max(s, 1} 
= exp{—(Aqs + Agt + A3 max(s,f))} 
(a) No, advertisements on pages having many ads are less likely to be chosen 


than are ones on pages with few ads. 
b) 


y, n(i) m 
(c) oe =7i/n, where 7i = > n(i)/m 
1 


@ ad — amyl PO _@ — ayy yam) 
mn ni(i) 
1 250 ie — 
(e) ye me, — n/n) = a 


(f) The number of iterations is aes with mean n./n 
(a) P{X =i} =1/m, i=1,. 
(b) Step 2. Generate a uniform o 1) random variable U. If U < n(X)/n, 
go to step 3. Otherwise return to step 1. 
Step 3. Generate a uniform (0, 1) random variable U, and select the 
element on page X in position [n(X)U] + 1. 
Yes, they are independent. This can be easily seen by considering the equiva- 
lent question of whether Xy is independent of N. But this is indeed so, since 
knowing when the first random variable greater than c occurs does not affect 
the probability distribution of its value, which is the uniform distribution 
on (c, 1). 
Let p; denote the probability of obtaining i points on a single throw of the dart. 
Then 


P30 = 1/36 

p20 = 41/36 — p39 = 1/12 
P10 = 92/36 — p20 — p30 = 57/36 
Po=1— Pio — P20 — p3o=1 — 2/4 


(a) 7/12 
(b) 7/9 
(c) 1 — 2/4 
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(d) 2(30/36 + 20/12 + 50/36) = 3577/9 

(e) (7/4)? 

(f) 2(7/36)(1 — 2/4) + 2(2/12)(57/36) 
6.13. Let Z be a standard normal random variable. 


(a) 
4 
; \\ Xi — 6 , 
P Ms O=Pp|= = 
[3x VA JA 
~ P(Z > —1.2247} © .8897 
(b) 
4 2 
PLY es 0| 0x; = -5 cee fee.) 
i=l i=l 
Ba y= 3 
=P et SE ee a5 zs > 2/V12 
J12 
~ P(Z > 5774} © .2818 
(c) 


4 
r| Sox > oxi =5| = P{X, + X3 + X4 > —5} 
i=l 


X. + X3 + X4 — 4.5 
=P > —9.5//18 
| Vis 


= P{Z > —2.239} ~ .9874 
6.14. In the following, C does not depend on n. 
P{N =n|X = x} = fxin(|n) PLN = n}/fx() 


= 1 n—-1 _ n—-1 
=e - pir” (=p) 


= Cal — p)x)"""/(n — 1)! 


which shows that, conditional on X¥ = x,N — 1 isa Poisson random variable 
with mean A(1 — p)x. That is, 


PIN =n|X =x} = PIN — 1l=n—- 1|X =x} 
=e OPAL — p)x) Tin — Dn = 1. 
6.15. (a) The Jacobian of the transformation is 


10 


be 


- 


As the equations uw = x,v =x + yimply that x = u,y = v — u, we obtain 


fuvu,v)=fxyu,v -u)=1, O<u<1, O<v—-u<tl 
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6.16. 


6.17. 


6.18. 


(b) 


or, equivalently, 
fu.vu.v) =1, max(v — 1,0) < u < mini, 1) 
For 0 < v < 1, 
Vv 
fy = / du=v 
0 
Forl =v = 2, 


1 
fr) = f du=2-—v 
v-1 


Let U be a uniform random variable on (7, 11). If you bid x,7 = x = 10, you 
will be the high bidder with probability 


3 3 
3 U—7 x—7 = x—7 
(P{U < x} = (>| A < Z \ = ( A ) 


Hence, your expected gain—call it E[G(x)]—if you bid x is 


E[G(x)] = 5 — 7)°(10 — x) 


Calculus shows this is maximized when x = 37/4. 
Let i1,i2,...,in, be a permutation of 1,2,...,n. Then 


PIX, = 4, X2 = bo,...,Xn = in} = PLM = HP {XD =} --- PU = hh} 


= PiPin*** Pin 
= Pip2°**Pn 


Therefore, the desired probability is m! pjp2--- pn, which reduces to a when 
all pj = 1/n. 


(a) 
(b) 


(c) 
(d) 


n n 
Because )> X; = >> Yj, it follows that N = 2M. 
i=l i=l 
Consider the n — k coordinates whose Y-values are equal to 0, and call 
them the red coordinates. Because the & coordinates whose X-values are 


equal to 1 are equally likely to be any of the 7 sets of k coordinates, 


it follows that the number of red coordinates among these & coordinates 
has the same distribution as the number of red balls chosen when one 
randomly chooses k of a set of 1 balls of which n — k are red. Therefore, 
M is a hypergeometric random variable. 

E[N] = E[2M] = 2E[M] = 4%@-® 

Using the formula for the variance of a hypergeometric given in 
Example 8] of Chapter 4, we obtain 


Var(N) = 4 Var(M) = 42 EK ~ k/n)(k/n) 


n 
6.19. (a) First note that S, — $;= )° Z;isanormal random variable with mean 


0 and variance n — k that is independent of S;. Consequently, given that 
S, = y, S, is anormal random variable with mean y and variance n — k. 
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(b) Because the conditional density function of S;, given that S, = x isa 
density function whose argument is y, anything that does not depend on 
y can be regarded as a constant. (For instance, x is regarded as a fixed 
constant.) In the following, the quantities C;,i = 1,2,3,4 are all constants 
that do not depend on y: 


F8i.8nV>*) 
Ts, @) 


1 
= Cif, is, XI )f5, 0) (wer is in) 


ie (y|x) — 


—¢,— be nm-6) 1 
V2aJ/n — k Jon Vk 


But we recognize the preceding as the density function of a normal ran- 


k(n — k) 
a 


dom variable with mean —x and variance 
n 
6.20. (a) 
P{X6 > X41 |X => max(X1, eae ,X5)} 


_ P{X6 > X1, X1 = max(X,...,X5)} 
P(X, = max(X1,...,X5)} 


_ P{X6 = max(Xj,...,X6), X1 = max(X1,...,X5)} 
a 1/5 


Thus, the probability that X¢ is the largest value is independent of which 
is the largest of the other five values. (Of course, this would not be true if 
the X; had different distributions.) 

(b) One way to solve this problem is to condition on whether X¥¢ > X1. Now, 


P{X6 > X2|X1 = max(Xj,...,X5), X6 > X1} =1 
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Also, by symmetry, 


1 
P{X6 > X2|X1 = max(Xj,...,X5), X6 = X}} = 5 


From part (a), 


1 
P{X6 > X1|X1 = max(X1, acy ,X5)} = a 
Thus, conditioning on whether X6 > XX yields the result 


1 15 67 
P{X6 > X2|X1 = max(Xj,...,X5)} = FA + = 


Se. 12 
CHAPTER 7 
TA. (a) d= > 1/ni) 


i=1 
(b) Pi XSjhH=P mt | =i — lH Pi — Lam aha Ym, 1=1,.4. 
m mom ~ m 1 
(c) e| |- —P{X =i}=) —~—=d 
nO) ~ 2 in = 
7.2. Let J; equal 1 if the jth ball withdrawn is white and the (j + 1)st is black, and 
let J; equal 0 otherwise. If X is the number of instances in which a white ball is 
immediately followed by a black one, then we may express X as 


n+m-1 


X= > Ij 
j=l 


Thus, 
n+m-1 
E[X]= 0 Eli 
j=l 
n+m-—1 
= > P{j" selection is white, (j + 1)” is black} 
j1 
n+m-1 
= 2 P{j” selection is white}P{j + 1)” is black|j” is white} 
j=l 
n+m-1 


= n m 


: n+mn+m-—t1 
j=l 


nm 


~n+tm 


The preceding used the fact that each of the n + m balls is equally likely to 
be the jth one selected and, given that that selection is a white ball, each of the 
other + m — 1 balls is equally likely to be the next ball chosen. 
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7.3. Arbitrarily number the couples, and then let J; equal 1 if married couple num- 


ber j,j = 1,...,10, is seated at the same table. Then, if X represents the 
number of married couples that are seated at the same table, we have 


SO 


a) To compute E[J;] in this case, consider wife number /. Since each of the 

(a) T pute E[J;] in thi id if ber j. Si h of th 
("?) groups of size 3 not including her is equally likely to be the remain- 
ing members of her table, it follows that the probability that her husband 


is at her table is 
1\ /18 
1 2 3 


oi 


E[X] = 30/19 


Hence, E[J;] = 3/19 and so 


(b) In this case, since the 2 men at the table of wife j are equally likely to be 
any of the 10 men, it follows that the probability that one of them is her 
husband is 2/10, so 


E{Jj]=2/10 and E[X]=2 


7.4. From Example 2i, we know that the expected number of times that the die 
need be rolled until all sides have appeared at least once is 6(1 + 1/2 + 1/3 + 
1/4 + 1/5 + 1/6) = 14.7. Now, if we let X; denote the total number of times 

6 


that side i appears, then, since )* X; is equal to the total number of rolls, we 
i=1 
have 
6 6 
14.7=E|) > X;| =) EX] 
i=1 


i=1 


But, by symmetry, E[X;] will be the same for all i, and thus it follows from the 
preceding that ELX,] = 14.7/6 = 2.45. 

7.5. Let J; equal 1 if we win 1 when the jth red card to show is turned over, and let 
J; equal 0 otherwise. (For instance, J, will equal 1 if the first card turned over 
is red.) Hence, if X is our total winnings, then 
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7.6. 


7.7. 


7.8. 


Now, J; will equal 1 if j red cards appear before j black cards. By symmetry, the 
probability of this event is equal to 1/2; therefore, E[J;] = 1/2 and ELX] = n/2. 
To see that N = n — 1 + J, note that if all events occur, then both sides of 
the preceding inequality are equal to n, whereas if they do not all occur, then 
the inequality reduces to N = n — 1, which is clearly true in this case. Taking 
expectations yields 

E[N] sn -—14 Ef/] 


However, if we let J; equal 1 if A; occurs and 0 otherwise, then 


EN=E) > G)=> A= > PAD 
i=1 i=1 i=1 


Since E[/] = P(A, --- Ay), the result follows. 
Imagine that the values 1,2,..., are lined up in their numerical order and that 
the k values selected are considered special. From Example 3e, the position 
of the first special value, equal to the smallest value chosen, has mean 1 + 
n-k n+1 
k+1 k+4+1 

For a more formal argument, note that X = j if none of the 7 — 1 smallest 
values are chosen. Hence, 


nxejel e )_ Gt) 
(i) G21) 


which shows that X has the same distribution as the random variable of Exam- 
ple 3e (with the notational change that the total number of balls is now n and 
the number of special balls is k). 

Let X denote the number of families that depart after the Sanchez family 
leaves. Arbitrarily number all the N — 1 non-Sanchez families, and let J/,, 
1=r=N — 1, equal 1 if family r departs after the Sanchez family does. Then 


N-1 
x= 
r=1 


Taking expectations gives 


N-1 
E|X] = 2s P{family r departs after the Sanchez family} 
r=1 
Now consider any non-Sanchez family that checked in k pieces of luggage. 
Because each of the k + j pieces of luggage checked in either by this family or 
by the Sanchez family is equally likely to be the last of these k + j to appear, 
the probability that this family departs after the Sanchez family is ay: Because 


the number of non-Sanchez families who checked in k pieces of luggage is nx 
when k # j, orn; — 1 when k =j, we obtain 


kn 1 
E[X] = — x 
] rae 2 
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7.9. Let the neighborhood of any point on the rim be the arc starting at that point 


7.10. 


and extending for a length 1. Consider a uniformly chosen point on the rim 
of the circle—that is, the probability that this point lies on a specified arc of 


length x is ~ and let XY denote the number of points that lie in its neighbor- 


1 
hood. With J; defined to equal 1 if item number j is in the neighborhood of the 
random point and to equal 0 otherwise, we have 


Taking expectations gives 


19 
E[X] = a P{item j lies in the neighborhood of the random point} 
j=l 


But because item j will lie in its neighborhood if the random point is located 


on the arc of length 1 going from item j in the counterclockwise direction, it 
follows that 


1 
P{item j lies in the neighborhood of the random point} = = 
a 


Hence, 


1 
BLX] = 5 > 3 


Because E[X] > 3, at least one of the possible values of X must exceed 3, 
proving the result. 


If g(x) = x!/2 then 


x2, ~3/2 


x) = 5 Ma) =—2 
BM =5 B®) =—7* 


so the Taylor series expansion of ./x about 4 gives 
VX a x/h, Sax =a a Pe nye 
Taking expectations yields 
E[VX] ~ VA + Sa WPELX = Se PEUX =e Fall 
=V7, - aay 


er aes 
8 
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Hence, 
Var(VX) = ELX] — (E[VX])? 


1 2 
i (v2 = we) 


1 


a jAcse 
Eo ea 


~ 1/4 
7.11. Number the tables so that tables 1, 2, and 3 are the ones with four seats and 


tables 4, 5, 6, and 7 are the ones with two seats. Also, number the women, and 
let X;,; equal 1 if woman / is seated with her husband at table j. Note that 


xy) ) : 


= (2105 


20 95” 
4 


1 1 
Exe = Se = ans 1 S45, G7 


20 190° 
2 


Now, X denotes the number of married couples that are seated at the same 
table, we have 


and 


10 7 
Ex\=E| > > XG 


i=1 j=1 


22 3 19 7 
= >>>) EX] + > EG] 
i=1 j=l i=1 j=4 


7.12. Let X; equal 1 if individual i does not recruit anyone, and let X; equal 0 other- 
wise. Then 


E|X;] = P{i does not recruit any of i + 1,i + 2,...,n} 


i-1 i n—2 
4 eek eA 
i-1l 
es | 


Hence, 
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From the preceding we also obtain 


i-1 i-1 (i — 1)" — i) 
Var(X;) = 1 a 
om ail ) (a — 1p 
Now, fori < j, 


i-1 p—-2j —-2j-—1 n-3 
E[X:X)] =... $=! 


15 a asa 
_ ¢€-D)G-2 
~ (n- 2am - 1) 
Thus, 
yy. @-DG-2 _i-1j-1 
C= oe = og = 1) n—-tIin-—-1 
_ €-DG-*” 
~ (n — 2)(n — 1/2 
Therefore, 


n n n—-1 on 
Var (E = )¢Var(X;) + 25° Y) Cov(Xi, Xj) 


i=1 i=1 j=i+l 


Ges) ey G@- DG - 7) 


| (n — 1)2 (n — 2)(n — 1)2 


i=1 J=i+l 
1 3 ; 


1 na | | 
(n — 2)(n — 1) a 1)Gt = nr = t= 1) 


7.13. Let X; equal 1 if the ith triple consists of one of each type of player. Then 
2 3 4 
1 1 1 2 
E|Xi] = = 


9 7 
3 
Hence, for part (a), we obtain 


3 
E bP x| = 6/7 


It follows from the preceding that 


Var(X;) = (2/7)(1 — 2/7) = 10/49 
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Also, for i # j, 


E[X;Xj] = P(X; = 1,X) = 1} 
= P{X; = 1}P{X) = 1|X; = 1} 


OOM @QG) 
G) G3) 


= 6/70 


Hence, for part (b), we obtain 


3 3 
Var (x x) =) Var(Xi) + 25° ¥° Cov(Xi, Xj) 
i=1 i=1 


j>l 
4 6 4 
= 30/4 2 eos ee 
io GIG =) 
Sie 
~ 490 


7.14. Let X;,i = 1,...,13, equal 1 if the ith card is an ace and let X; be 0 otherwise. 
Let Y; equal 1 if the jth card is a spade and let i,j = 1,...,13, be 0 otherwise. 
Now, 


n n 
Cov(X, Y) = Cov x.y, Yj 
i=l j=l 


n n 
=) Corey. y) 
i=1 j=1 
However, X; is clearly independent of Y; because knowing the suit of a par- 
ticular card gives no information about whether it is an ace and thus cannot 
affect the probability that another specified card is an ace. More formally, let 
Aj,s,Aj,n, Ai, d,Ai,c be the events, respectively, that card i is a spade, a heart, a 
diamond, and a club. Then 
1 
P= =e aa eG a 
+ P{Y; = 1Aia} + PLY; = 1Aic}) 
But, by symmetry, we have 


P{Y; = Ais} = PLY; = 1Ain} = PLY; = WAza} = PLY; = 1Aic} 


Therefore, 
P(Y; = 1) = P{Y} = 114i} 


As the preceding implies that 
P{Y; = 1} = P{Y; = 11Aj,} 
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we see that Y; and X; are independent. Hence, Cov(Xj, Y;) = 0, and thus 
Cov(X, Y) = 0. 

The random variables X and Y, although uncorrelated, are not indepen- 
dent. This follows, for instance, from the fact that 


P(Y =13|X =4} =0 # PLY = 13} 


7.15. (a) Your expected gain without any information is 0. 
(b) You should predict heads if p > 1/2 and tails otherwise. 
(c) Conditioning on V, the value of the coin, gives 


1 
E[Gain] = / E[Gain|V = p] dp 
0 


1/2 1 
-| [1d — p) — 1@)]dp + / [1(p) — 1. — p)] dp 
0 1/2 
= 1/2 
7.16. Given that the name chosen appears in n(X) different positions on the list, 
since each of these positions is equally likely to be the one chosen, it fol- 


lows that 
E[I|n(X)] = PU = 1|n(X)} = 1/n(X) 


Hence, 
E\1]| = Efl/ncx)] 


Thus, E[m/] = E[m/n(X)] = d. 
7.17. Letting X; equal 1 if a collision occurs when the ith item is placed, and letting 
it equal 0 otherwise, we can express the total number of collisions X as 


Therefore, 


To determine E[X;], condition on the cell in which it is placed. 


FXG |= S E[X;j| placed in cellj]p; 
j 
— > P{i causes collision|placed in cell j]p; 
j 


=) - 4 = pb 
J 


=1- 0d - p)'p; 
j 
The next to last equality used the fact that, conditional on item i being placed 


in cell j, item i will cause a collision if any of the preceding i — 1 items were 
put in cell 7. Thus, 
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7.18. 


7.19, 


m n 


E[X]=m —- )°)>0d - p*'p; 


i=1 j=1 
Interchanging the order of the summations gives 
n 
E[X] =m —n+ yd — pj)" 
j=l 
Looking at the result shows that we could have derived it more easily by taking 
expectations of both sides of the identity 


number of nonempty cells = m — X 


The expected number of nonempty cells is then found by defining an indicator 
variable for each cell, equal to 1 if that cell is nonempty and to 0 otherwise, 
and then taking the expectation of the sum of these indicator variables. 


Let L denote the length of the initial run. Conditioning on the first value gives 


+ E[L|first value is zero] = 
n 


E[L] = E[L|first value is one] “ rf 
n+m m 


Now, if the first value is one, then the length of the run will be the position of 
the first zero when considering the remaining n + m — 1 values, of whichn — 1 
are ones and m are zeroes. (For instance, if the initial value of the remaining 
n +m — 1 is zero, then L = 1.) As a similar result is true given that the 
first value is a zero, we obtain from the preceding, upon using the result from 
Example 3e, that 


n+m n _arm m 


E{L| = 
[1] m+in+m n+in+m 
n m 


a n+1 


m+1 


Let X be the number of flips needed for both boxes to become empty, and let 
Y denote the number of heads in the first 1 + m flips. Then 


E[X] = y E[X|Y = iJP{Y = 


=) e[XY =] e a )p'a =p 
i=0 


Now, if the number of heads in the first n + m flips is i, i = n, then the number 
of additional flips is the number of flips needed to obtain an additional n — i 
heads. Similarly, if the number of heads in the first n + m flips is 7, i > n, 
then, because there would have been a total of n + m — i < m tails, the 
number of additional flips is the number needed to obtain an additional i — n 
heads. Since the number of flips needed for j outcomes of a particular type is a 
negative binomial random variable whose mean is j divided by the probability 
of that outcome, we obtain 
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EX] = > — -(" it ”) pia a a 


L 
i=0 2 


n+m i_n ; ; 
+ > : « rr ”) pia _ pee 
: =p : 
i=n+1 


7.20. Taking expectations of both sides of the identity given in the hint yields 


E[X"|=E n [xc as| 
0 


n [ E(x”! Ix (x)] dx 
0 


n [oe eux) dx 
0 


oo — 
nf x" TF (x) dx 
0 


Taking the expectation inside the integral sign is justified because all the ran- 
dom variables [y(x),0 < x < oo, are nonnegative. 


7.21. Consider a random permutation /;,..., J, that is equally likely to be any of the 
n! permutations. Then 


Elazar,,1] = 2 Elazar, lj = k|Ptlj = k} 

k 
1 

=. YS aE lar, lj =k] 

k 

1 : 

== dae 2 a;PUjy1 = ill; = kK} 

L 


1 
= ae = D de Dm 


i#k 


fl 
nn — 1) S ag(—ag) 
n(n a 
< 0 


where the final equality followed from the assumption that )>/_, a; = 0. Since 
the preceding shows that 


nt 
E > ajay, | < 0 
j=l 
it follows that there must be some permutation /1,..., 7, for which 


n 
Si < 0 
j=l 
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7.22. (a) E[X]=a1 + 42, E[X]=42 + A3 


7.23. 


7.24, 


(b) 


Cov(X, Y) = Cov(X, + X,X2 + X3) 
= Cov(“%1,X2 + X3) + CovGXa, Xo + X3) 
= Cov(X2, X2) 
= Var(X) 
=A 


(c) Conditioning on X2 gives 
P(X =i,Y=j}= Yo P{X = i, Y = j|X. = k}P{X. = k} 
k 
=) P(X =i — k,X3 =] — kX) = kje a5 /k! 
k 
= P(X, =i — k,X3=j — ke A5/k! 
k 


=) PX, =i — KP(X3 =j — ke ™a5/k! 


k 

min(i,j/) i-k j-k k 
= > on Ay e743 i en 7) 

= (i — k)! (j — k)! k! 


Cc Cop ee & 
Corr 2? Xi, > Yj] = es zz u 
F ; Jf Var(d XN Var Yj) 


_ doi Lj Cov(Xi, Yj) 
[nozno; 


NOxOy 


NPOxOy 
NOxO0y 
=p 
where the next to last equality used the fact that Cov(X;, Yi) = poxoy 


Let X; equal 1 if the ith card chosen is an ace, and let it equal 0 otherwise. 
Because 


and E[X;] = P{X; = 1} = 1/13, it follows that E[X] = 3/13. But, with A being 
the event that the ace of spades is chosen, we have 
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E[X] = E[X|A]P(A) + E[X|A‘]P(A) 


3 49 
= E[XIA]S + EXITS 
3 
3 49 ° 
= E[XlA], + GE 2 *ilA 
5 4S 
—_— Pee ae aor . Cc 
= E[X|A] re 2, E[X;|A‘] 
3 49. 3 


Using that ELX] = 3/13 gives the result 
52 (3 49 3 19 
E[X|A] = = — = 1.1176 
el) 3 (3 a) 17 : 
Similarly, letting L be the event that at least one ace is chosen, we have 
E[X] = E[X|L]P(L) + E[XILIP(L9 
= E[X|L]P(L) 


_ ELIZ] ( _ 48-47. 6) 


52 - 51 - 50 
Thus, 
3/13 

1 — 4847-46 

52-51-50 
Another way to solve this problem is to number the four aces, with the ace of 
spades having number 1, and then let Y; equal 1 if ace number / is chosen and 
0 otherwise. Then 


E[X|L] = ~ 1.0616 


E[X|A] = e| Dvn 


4 
=14+ 0 2[¥I¥1 =1] 
i=2 

2 

=14+3- —=19/17 

51 / 
where we used that the fact given that the ace of spades is chosen the other 
two cards are equally likely to be any pair of the remaining 51 cards; so the 


conditional probability that any specified card (not equal to the ace of spades) 
is chosen is 2/51. Also, 


4 


E[X|L] = ap Y; | = >> E[Yi|L] = 4P{¥; = 1|L} 


i=1 


ae P(AL) P(A) 3/52 
PLY; = 1|L} = P(A|L) = = = 48-47-46 
PL) PU) 1 sary 


we obtain the same answer as before. 
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7.25. (a) E[I|X =x] = P{Z < X|X =x} =P{Z < x|X =x} =P{Z < x} = Ox) 


(b) It follows from part (a) that E[J|X] = ®(X). Therefore, 
El] = ELE[L|X]] = E[®(X)] 


The result now follows because E[7] = P{J = 1} = P{Z < X}. 
(c) Since XY — Z is normal with mean p and variance 2, we have 


PY = Fa PixX = Zs H 


7.26. Let N be the number of heads in the first n + m — 1 flips. Let M = max(X, Y) 


be the number of flips needed to amass at least n heads and at least m tails. 
Conditioning on N gives 


E[M] = )° E[MIN = i]PIN = i} 


L 


n—1 n+m-—1 
=)°E[M|IN=i]P(N= + > E[MIN=i)P(N=3 
i=0 i=n 


Now, suppose we are given that there are a total of i heads in the first n-+m— 1 
trials. Ifi < n, then we have already obtained at least m tails, so the additional 
number of flips needed is equal to the number needed for an additional n — i 
heads; similarly, if i = n, then we have already obtained at least n heads, so 
the additional number of flips needed is equal to the number needed for an 
additional m — (n + m — 1 — i) tails. Consequently, we have 


n—-1 F 
FM => (n Lm—14 “—") P= 
i=0 P 
n+m—-1 , 
1 _ 
a} (x et ae ") Pww=i 
= Lp 
=n 
—1 F 
ee re y= (" a ‘)pla apie 
; Pp l 
i=0 
ed = ea 
T T a 1 _ n+m—1-i 
- Ps sor ( Jp P) 


The expected number of flips to obtain either 1 heads or m tails, E[min(X, Y)], 
is now given by 
: n m 
E[min(x, Y)] = E[X + Y — MJ=— + a E[M] 
P — ?P 


Solutions to Self-Test Problems and Exercises 511 


7.27. This is just the expected time to collect n — 1 of the n types of coupons in 
Example 2i. By the results of that example the solution is 


7.28. Withg =1 — p, 


[o-e) n n 
, i= 
E[X]= (P(X =) =) PX ==) gh = pound 
isl i=l i=] 2 
7.29. 


Cov(X, Y) = E[XY] — E[X]E[Y] = P(X =1,Y =1) — P(X =)P(Y = 1) 


Hence, 


Cov(X¥,Y)=0 S&S PY=1Y=)=PX=)P(Y =1) 


Because 


Cov(X, Y) = Cov(1 — X,1 Y) = —Cov(1 — X,Y) = —Cov(x,1 — Y) 


the preceding shows that all of the following are equivalent when X and Y are 
Bernoulli: 
1. Cov(x, Y) =0 
PX =1,Y=)=PX=1)P(Y =1) 
.PA- xX =1,1-Y=)=Pd -xX=)Pd - Y=)h 
.PA- xX =1,Y=)D=Pd - X=)P(Y =1) 
. PX =1,1 - Y=)=PX=1PA - Y=1) 


7.30. Number the individuals, and let X;; equal 1 if the jth individual who has hat 
size i chooses a hat of that size, and let X;,; equal 0 otherwise. Then the number 
of individuals who choose a hat of their size is 


ron 
X=) DXi 
i=1 j=l 
Hence, 
ro nj rooNnj a ee 
E[X] = Yodo EX] = ae a = Se hini 
i=1 j=1 i=1 j=1 i=1 
CHAPTER 8 


8.1. Let X denote the number of sales made next week, and note that_X is integral. 
From Markov’s inequality, we obtain the following: 


(a) P{X > 18} = P{X = 19} = As) = 16/19 


(b) P{X > 25} = PLX = 26} = at = 16/26 
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8.2. (a) 
P10 Ss X S 22} = P{|\X — 16| = 6} 
= P{|X — p| = 6} 


=1-— P{|X — p| > 6} 
>1— 9/36 =3/4 


(b) P{X = 19} = P{X — 16 = 3} < ae 


In part (a), we used Chebyshev’s inequality; in part (b), we used its 
one-sided version. (See Proposition 5.1.) 


8.3. First note that ELY — Y]=0 and 
Var(X — Y) = Var(X) + Var(Y) — 2Cov(X, Y) = 28 
Using Chebyshev’s inequality in part (a) and the one-sided version in parts (b) 


and (c) gives the following results: 
(a) P{|X — Y| > 15} S 28/225 


28 
_ i 
(b) P{X — Y > 15} = 58 005 28/253 
28 
P{Y — X > 15} S ———— = 28/253 
(c) Pf = AOS 55 ae /25 
8.4. If X is the number produced at factory A and Y the number produced at fac- 


tory B, then 


E[Y — X)=-2, Var(Y — X)=364+ 9=45 
45 


PY —~X > O0}=P{(Y —-X=Y=P(Y -X+2=3}s 
{ SoS F{ r= ey 4 = B90 


= 45/54 


8.5. Note first that 


1 
E[X;] = [ 2x* dx = 2/3 


Now use the strong law of large numbers to obtain 


oe Sn i 


=1/(2)/4)=3/2 
8.6. Because E[X;] = 2/3 and 


1 
E[X?] = , 2x7 dx = 1/2 
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we have Var(X;) = 1/2 — (2/3)? = 1/18. Thus, if there are nm components on 
hand, then 


P{Sy, = 35} = P{Sp, = 34.5} (the continuity correction) 
sala = 2n/3 _ 34.5 — aa 


Vnfi8 ———/n/18 
ee 


Vn/18 


where Z is a standard normal random variable. Since 


~P\z= 


P{Z > —1.284} = P{Z < 1.284} = .90 
we see that 1 should be chosen so that 
(34.5 — 2n/3) ® —1.284,/n/18 


A numerical computation gives the result n = 55. 


8.7. If X is the time required to service a machine, then 
E[XAJ=H24+ 3=.5 


Also, since the variance of an exponential random variable is equal to the 
square of its mean, we have 


Var(X) = (.2)? + (3)? =.13 


Therefore, with X; being the time required to service job i,i = 1,...,20, and Z 
being a standard normal random variable, it follows that 


Xi +--+» + Xo — 10 8 — 10 


Pes op He eae Z 
ee 20 < 8} V2.6 V2.6 
= P(Z < 1.24035} 


1074 


2 


8.8. Note first that if X is the gambler’s winnings on a single bet, then 


E[X] =—-—.7 — 44+ 1=-.1,E[X?]=.7 + 8 + 10=115 
—>Var(X) = 11.49 


Therefore, with Z having a standard normal distribution, 


Ais + Ato PID Sa eM 
/1149 1149 

P{Z < .2803} 

.6104 


Pay eee Ang = =e P 


2 


2 
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8.9. 


8.10. 


8.11. 


Using the notation of Problem 7, we have 


P{X, +--+. + Xo < a=r| 


plz t — 10 
& < 
V2.6 


Now, P{Z < 1.645} = .95, so t should be such that 


Xi +--+ + Xo — 10 t — 10 
< —— 
J/2.6 /2.6 


t — 10 


= 1.645 
V2.6 


which yields t ~ 12.65. 


If the claim were true, then, by the central limit theorem, the average nicotine 
content (call it X) would approximately have a normal distribution with mean 
2.2 and standard deviation .03. Thus, the probability that it would be as high 
as 3.1 is 


X — 2.2 3.1 — 2.2 


P{X > 3.1}=P > 
} /.03 J 03 
~ PIZ > 5.196} 


= 0 


where Z is a standard normal random variable. 


(a) If we arbitrarily number the batteries and let X; denote the life of battery 
i,i = 1,...,40, then the X; are independent and identically distributed 
random variables. To compute the mean and variance of the life of, say, 
battery 1, we condition on its type. Letting J equal 1 if battery 1 is type A 
and letting it equal 0 if it is type B, we have 


E[.4|f = 1) = 50, E[X,|7 = 0] = 30 
yielding 
E[X1] = SOP{7 = 1} + 30P{Z = 0} = 50(1/2) + 30(1/2) = 40 
In addition, using the fact that E[W?] = (E[W])* + Var(W), we have 
E[X?|I = 1] = (50)* + (15) = 2725, = E[X?|1 = 0] = G0)* + 6 = 936 
yielding 
E[X?] = (2725)(1/2) + (936)(1/2) = 1830.5 


Thus, X1,...,X49 are independent and identically distributed random 
variables having mean 40 and variance 1830.5 — 1600 = 230.5. Hence, 


with S = ye X;, we have 


E{S] = 40(40) = 1600, Var(S) = 40(230.5) = 9220 
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and the central limit theorem yields 


S — 1600 1700 — 1600 
Jo0  ~—~-/9220 

~ P{Z > 1.041} 

=1— (1.041) = .149 


P{S > 1700} = P 


(b) For this part, let S4 be the total life of all the type A batteries and let Sz be 
the total life of all the type B batteries. Then, by the central limit theorem, 
S has approximately a normal distribution with mean 20(50) = 1000 and 
variance 20(225) = 4500, and Sz has approximately a normal distribution 
with mean 20(30) = 600 and variance 20(36) = 720. Because the sum of 
independent normal random variables is also a normal random variable, 
it follows that S4 + Sg is approximately normal with mean 1600 and 
variance 5220. Consequently, with $ = S4 + Sp, 


S — 1600 1700 — 1600 
Vsm00~—~—SC«S 52D 

~ P{Z > 1.384} 

—1 — (1.384) = .084 


P{S > 1700} = P 


8.12. Let N denote the number of doctors who volunteer. Conditional on the event 
N = i, the number of patients seen is distributed as the sum of i indepen- 
dent Poisson random variables with common mean 30. Because the sum of 
independent Poisson random variables is also a Poisson random variable, it 
follows that the conditional distribution of X given that N = 7 is Poisson with 
mean 30i. Therefore, 


E[X|N]=30N  Var(X|N) = 30N 


As a result, 


E[X] = E[E[X|N]] = 30E[N] = 90 
Also, by the conditional variance formula, 
Var(X) = E[Var(X|N)] + Var(E[X|N]) = 30E[N] + (30)*Var(N) 


Because 


Var() = 52° Pee 4 y= 995 


we obtain Var(X) = 690. 

To approximate P{X > 65}, we would not be justified in assuming that the 
distribution of X is approximately that of a normal random variable with mean 
90 and variance 690. What we do know, however, is that 


4 4 
P{X > 65}=)  P{X > 65|N = i}P{N = i} = 5 PH65) 
i=2 i=2 
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where P;(65) is the probability that a Poisson random variable with mean 30i 
is greater than 65. That is, 

65 

P,(65) =1 — )\e Goi /j! 

j=0 
Because a Poisson random variable with mean 30 has the same distribution 
as does the sum of 30i independent Poisson random variables with mean 1, 
it follows from the central limit theorem that its distribution is approximately 
normal with mean and variance equal to 30i. Consequently, with X; being a 
Poisson random variable with mean 30i and Z being a standard normal ran- 
dom variable, we can approximate P;(65) as follows: 


P;(65) = P{X > 65} 
= P{X = 65.5} 
XxX = 30 .. 6S — 30; 
—P = 
V30i /30i 


Therefore, 
P,(65) © P{Z = .7100} = .2389 
P3(65) © P{Z = —2.583} ~ .9951 
P4(65) © P{Z = —4.975} = 1 


leading to the result 
P{X > 65} = .7447 


If we would have mistakenly assumed that XY was approximately normal, we 
would have obtained the approximate answer .8244. (The exact probability is 
.7440.) 


Take logarithms and then apply the strong law of large numbers to obtain 


Wn 1jn n 
log (1 x) = ~ ¥ log( Xi) BllogX)] 
i=1 


i=1 


Therefore, 
1/n 


n 
i=1 


CHAPTER 9 


9.1. 


From axiom (iii), it follows that the number of events that occur between times 
8 and 10 has the same distribution as the number of events that occur by time 
2 and thus is a Poisson random variable with mean 6. Hence, we obtain the 
following solutions for parts (a) and (b): 

(a) P{N(10) — N(8) = 0} =e 

(b) E[N(10) — N(8)] =6 
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(c) It follows from axioms (ii) and (iii) that, from any point in time onward, 
the process of events occurring is a Poisson process with rate 4. Hence, 
the expected time of the fifth event after 2P.M. is 2 + E[Ss] = 2 + 5/3. 
That is, the expected time of this event is 3:40 P.M. 
9.2. (a) 
P{N(1/3) = 2|N(1) = 2} 
_ P{N(1/3) = 2,N(1) = 2} 
a P{N(1) = 2} 
_ P{N(1/3) =2,NQ) — N(1/3) = 0} 
7 P{N(1) = 2} 
_ P{N(1/3) = 2}P{N() — N(1/3) = 0} 
= P{N(1) = 2} 
P{N(1/3) = 2}P{N(2/3) = 0} (oy ate ae) 
= iti 
P{N() = 2) y 
PO By ier 
- e*)2/2! 


(by axiom (ii)) 


=1/9 
(b) 
P{N(1/2) = 1|N(1) = 2} =1 — P{N(1/2) = 0|N(1) = 2} 
P{N(1/2) = 0,N(1) = 2} 


= P{N(l) = 2} 
= P{N(1/2) = 0,N(1) — N(1/2) = 2} 
= P{N(1) = 2} 
_ 1 _ PING/2) = 0}PING) — NA/2) = 2} 
P{N(1) = 2} 
4 P{N(1/2) = 0}P{N(1/2) = 2} 
P{N(1) = 2} 
ett e-*2 2)? (2! 
=1 
e442 /2! 
=1-—- 1/4=3/4 


9.3. Fix a point on the road and let X,, equal 0 if the nth vehicle to pass is a car 
and let it equal 1 if it is a truck, nm = 1. We now suppose that the sequence 
Xn,n = 1, is a Markov chain with transition probabilities 


Poo =5/6, Por =1/6, Pig =4/5, Pia =1/5 
Then the long-run proportion of times is the solution of 
mg = 10(5/6) + 11(4/5) 
m = m9(1/6) + 21 (1/5) 
m +m =1 


Solving the preceding equations gives 
my = 24/29 m = 5/29 
Thus, 2400/29 ~ 83 percent of the vehicles on the road are cars. 
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9.4. The successive weather classifications constitute a Markov chain. If the states 
are 0 for rainy, 1 for sunny, and 2 for overcast, then the transition probability 
matrix is as follows: 


0 1/2 1/2 
P= 1/3 1/3 1/3 
1/3 1/3 1/3 


The long-run proportions satisfy 
m = 7 (1/3) + 22(1/3) 
m = mo(1/2) + m1 (1/3) + m2(1/3) 
m2 = mo(1/2) + m1 (1/3) + 22(1/3) 
l=m+m+%m 


The solution of the preceding system of equations is 
m=1/4, m=3/8, m=3/8 


Hence, three-eighths of the days are sunny and one-fourth are rainy. 
9.5. (a) A direct computation yields 


H(X)/H(Y) © 1.06 


(b) Both random variables take on two of their values with the same prob- 
abilities .35 and .05. The difference is that if they do not take on either 
of those values, then X, but not Y, is equally likely to take on any of its 
three remaining possible values. Hence, from Theoretical Exercise 13, we 
would expect the result of part (a). 


CHAPTER 10 
10.1. (a) 
1 
ies edx => C=1/(e —- 1) 
0 
(b) 
x e—1 
Fay=c | edy= , OFx=1 
0 e—1 
Hence, if we let ¥ = F~!(U), then 
| 
Us= 
e—1l 


or 
X = log(U(e — 1) + 1) 


Thus, we can simulate the random variable X by generating a random 

number U and then setting X = log(U(e — 1) + 1). 
10.2. Use the acceptance-rejection method with g(x) = 1,0 < x < 1. Calculus shows 
that the maximum value of f(x)/g(x) occurs at a value of x,0 < x < 1, such that 


2x — 6x7 + 4° -0 


Solutions to Self-Test Problems and Exercises 519 
or, equivalently, when 
4x? — 6x + 2= (4x — 2)(e — 1)=0 
The maximum thus occurs when x = 1/2, and it follows that 
C = maxf(x)/g(x) = 30(1/4 — 2/8 + 1/16) = 15/8 


Hence, the algorithm is as follows: 


Step 1. Generate a random number Uj. 
Step 2. Generate a random number U3. 
Step 3. If U2 = 16(U; — 2U} + Uy), set X = Uj; else return to Step 1. 


10.3. It is most efficient to check the higher probability values first, as in the follow- 
ing algorithm: 


Step 1. Generate a random number U. 
Step 2. If U = .35, set X¥ = 3 and stop. 
Step 3. If U = .65, set X = 4 and stop. 
Step 4. If U = .85, set X = 2 and stop. 
Step 5. X =1. 


10.4. 2u — X 
10.5. (a) Generate 2n independent exponential random variables with mean 1, X;, Yi,i = 


n 
1,...,”, and then use the estimator )° eXiXi/n, 


i=1 
(b) We can use XY as a control variate to obtain an estimator of the type 
n 
Doe + cXi¥DIn 
i=1 


Another possibility would be to use XY + X*Y7/2 as the control variate 
and so obtain an estimator of the type 


rn 
Sikh + cLXiY; + X?¥?/2 - 1/2)/n 
i=l 


The motivation behind the preceding formula is based on the fact that the 
first three terms of the MacLaurin series expansion of e” are 1 + xy + 


(xy?) /2. 
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random number of, 335 
expectation of sums of, 298-315 
expected value (expectation), 
125-128 
sums of, 164-168 
exponential, 208 
gamma, 254-255 
geometric, 155-157, 260-263 
hypergeometric, 160-163 
Identically distributed uniform, 
252-254 
independent, 240-251 
joint probability distribution of 
functions of, 274-282 
jointly continuous, 239 
moment generating functions, 
354-365 
of the sum of a random 
number of, 361-363 
negative binomial, 157-160 
normal, 198-204, 256-259 
order statistics, 270-274, 286 
Poisson, 143-145, 171, 259-260 


uniform, 194-198 
variance, 171 
variance of a sum of a random 
number of, 349 
Weibull, 217 
zeta (Zipf) distribution, 163-164 
Random walk, 422 
Rate of transmission of information, 
436 
Rayleigh density function, 229 
Recherches sur la probabililé des 
jugements en matiére 
criminelle et en matiére 
civile (Investigations into the 
Probability of Verdicts in 
Criminal and Civil Matters), 
143 
Rejection method, 442-444, 453-454 
simulating a chi-squared 
random variable, 446-447 
simulating a normal random 
variable, 443-444 
polar method, 445-446 
Riemann, G. F. B., 164 


S 
Sample mean, 300, 372 
joint distribution of, 367-369 
joint distribution of sample 
variance and, 367-369 
Sample median, 272 
Sample spaces: 
and events, 22-26, 49 
having equally likely outcomes, 
33-44 
Sample variance, 324, 372 
joint distribution of sample 
mean and, 367-369 
Seed, 439 
Selected problems, answers to, 
456-457 
Self-text problems/exercises, 
458-516 
Sequence of interarrival times, 418 
Sequential updating of information, 
99-101 
Shannon, Claude, 433 


Simulation, 438-456 


of continuous random variables: 


general techniques for, 
440-447 
inverse transformation 
method, 441-442, 453 
rejection method, 442-444, 
453-454 
defined, 438 
from discrete distributions, 
447-449 
pseudorandom numbers, 439 
random-number generator, 439 
random numbers, 439, 453 
random permutation, 
generating (example), 
439-440 
seed, 439 
variance reduction techniques, 
449-453 
Simulation, defined, 246 
Singletons, in coupon-collecting 
problem, 321-322 
Size of the zeroth generation, 383 
St. Petersburg paradox, 175 
Standard deviation of X, 134, 171 
Standard deviations, 414 
Stationary increment assumption, 
417 
Stieltjes integrals, 369-370 
Strong law of large numbers, 
400-403, 412 
Subjective view of probability, 48 
Sums of random variables: 
expectation of, 298-315 
binomial random variable, 
300-301 
Boole’s inequality, 300-301 
coupon-collecting problems, 
303 
coupon collecting with 
unequal probabilities, 
314-315 
expectation of a binomial 
random variable, 301 
expected number of matches, 
303 
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expected number of runs, 
304-305 
hypergeometric random 
variable, mean of, 302 
maximum-—minimums 
identity, 313-314 
negative binomial random 
variable, mean of, 301-302 
probability of a union of 
events, 308-310 
quick-sort algorithm, 
analyzing, 306-308 
random walk in a plane, 
305-306 
sample mean, 300 
Superset, 24 
Surprise concept, 425-426 


T 

Theory of games, 175 

Transition probabilities, Markov 
chains, 420 

Trials, 82 


U 

Uncertainty, 426-427 

Uniform random variables, 194-198 
Union, 23-24, 49 

Updated probability, 99-100 
Updating information sequentially, 
99-101 

Utility, 130-131 


V 
Variables, 163-164, See also 
Random variables 
antithetic, 450-451 
Variance, 171 
conditional, 347-349 
covariance, 322-323 
of geometric distribution, 340 
sample, 324, 372 
Variance reduction: 
antithetic variables, use of, 
450-451 
by conditioning, 451-452 
control variates, 452-453 
techniques, 449-453 
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Venn diagram, 24-25 Wheel of fortune game 

Vertices, 91 (chuck-a-luck) (example), 
136 

Ww Wilcoxon sum-of ranks test, 376 

Waiting time, 419 

Weak law of large numbers, 388-391 Zeroth generation, size of, 383 

Weibull distribution, 216-217 Zeta (Zipf) distribution, 163-164 


Weibull random variables, 217 Zipf, G. K., 164 


